🛡️ AI Safety & Alignment

AI safety research, alignment techniques, interpretability, governance, and existential risk discussions.

1,186 articles

Andrew Ng slams extinction fears as a tactic to choke off competition

AI pioneer Andrew Ng, a co-founder of Google Brain, rejects the idea that AI could wipe out humanity. He accuses tech companies of leaning on invented safety arguments to stifle competition. Source: nypost.com

Google DeepMind COO weighs in on whether AI could drive humanity to extinction

Lila Ibrahim, COO of Google DeepMind, discusses AI's existential risks, safety frameworks and external evaluations. She stresses the need for global collaboration on regulation. Source: ndtvprofit.com

AI Engineer World's Fair to stop growing after 2026, swyx says

At a closing Q&A session at Moscone Center, organizer swyx announced that the AI Engineer World's Fair will stop expanding after 2026, with the 2027 edition set to differ. Source: finance.biggo.com

CNN asks readers: what are your questions about AI safety risks?

After a wave of warnings about existential risks from AI, CNN wants to learn what big questions its audience has about serious AI fears. Source: yahoo.com

Microsoft's Brad Smith: milk is regulated more strictly than AI

Microsoft president Brad Smith called for global safety rules, including mandatory notification of victims when rogue AI agents cause breaches, plus an emergency shutdown mechanism. Source: freemalaysiatoday.com

El-Sayed calls AI an 'existential threat'

Michigan Senate candidate Abdul El-Sayed has put forward an AI safety framework aimed at preventing existential threats. It includes a call to freeze frontier AI development. Source: thehill.com

UK gets early access to safety-test frontier AI models, minister says

A UK minister says the country will be able to safety-test the latest AI models. Scrutiny of AI safety has grown since developers including Anthropic and OpenAI reported cases of AI agents behaving in rogue or unwanted ways. Source: m.economictimes.com

AI founders cheer Trump's call for the industry to police itself on safety

At Tech Week in San Francisco, venture capitalists and AI founders have welcomed the White House's hands-off approach to AI regulation. Mood in the industry is upbeat. Source: kqed.org

AI's risks are no reason for panic

Borrowing William Goldman's line about the movie business, 'nobody knows anything,' the piece argues the same holds for artificial intelligence today. Uncertainty over AI's risks, it suggests, should not lead to panic. Source: koreatimes.co.kr

Will AI kill us all?

Drawing on historical examples, the article notes that humanity has long been prone to self-destruction, from natural disasters and accidents to conflict. It weighs this record against fears about AI. Source: pmg-ky1.com

ASEAN's AI opportunity hinges on trustworthy governance

As AI grows more autonomous and its risks increasingly cross borders, Southeast Asia needs trusted, interoperable governance. Without it, the region may struggle to make the most of the technology. Source: govinsider.asia

Exclusive: AI safety 'doomers' funnel cash into Minnesota Senate race for Peggy Flanagan

AI safety 'doomers' have entered Minnesota's US Senate race, donating thousands of dollars to Democrat Peggy Flanagan, who is backed by Bernie Sanders. Source: nypost.com

CNN asks readers: what are your questions about AI safety risks?

After a wave of warnings about existential risks from AI, CNN wants to learn which big questions its audience has about serious AI fears. The outlet is inviting readers to send in their questions. Source: cnn.com

DeepMind COO weighs in on whether AI could threaten humanity's survival

Google DeepMind's Chief Operating Officer Lila Ibrahim addressed the question of whether AI could pose an existential threat to humanity. She discussed the risks of the technology and the safeguards needed to manage them. Source: ndtvprofit.com

Joseph Gordon-Levitt named UN's first advocate for human-centric digital governance

Actor Joseph Gordon-Levitt, appointed as the UN's first human-centric digital governance advocate, warned in a New York Times interview that AI companies are chasing economic dominance. Source: tech-insider.org

Study: three in five AI models fail terrorism safety tests

A study found that three in five AI models failed terrorism-related safety tests. Models stripped of their safeguards consistently produced potentially harmful content. Source: aa.com.tr

OpenAI dismisses three researchers over sensitive information breach

OpenAI fired three researchers over alleged mishandling of sensitive information. The move comes amid growing tensions over AI safety and the risks of increasingly powerful systems. Source: iol.co.za

The dangers of AI are real, but panic is the wrong response

Borrowing screenwriter William Goldman's line that 'nobody knows anything' about the movie business, the piece argues the same uncertainty applies to AI today. Given how little is truly known, it suggests the risks call for sober assessment rather than alarm. Source: koreatimes.co.kr

Silicon Valley AI founders applaud Trump's push for industry self-policing on safety

At Tech Week in San Francisco, venture capitalists and AI founders were upbeat about the White House's hands-off approach to AI regulation. Many welcomed the call for the industry to oversee its own safety. Source: abcnews.com

Bill Gates calls on governments to tighten AI safety rules

Bill Gates urged stronger AI regulation, likening safety rules to those governing cars and medicines. He also warned about misuse of the technology and called for balanced oversight. Source: the420.in