🛡️ AI Safety & Alignment

AI safety research, alignment techniques, interpretability, governance, and existential risk discussions.

1,186 articles

Study: 60% of AI models fail terrorism-related safety tests

Researchers found that models with their safety safeguards removed reliably answer potentially dangerous requests. The findings are based on media reports of the study. Source: trtworld.com

Editorial: The risks of AI are no cause for panic

Borrowing screenwriter William Goldman's line that 'nobody knows anything' about the movie business, the editorial argues the same applies to artificial intelligence today. Uncertainty, it suggests, is a reason for caution rather than alarm. Source: thederrick.com

Are AI leaders genuinely afraid of their own technology?

When tech CEOs warn that their products could kill us all, are they sincere or just selling something? The piece weighs whether these fears are real or a marketing strategy. Source: vox.com

Silicon Valley AI founders welcome Trump's push for industry self-policing on safety

Tech Week is in full swing in San Francisco, filling the city's restaurants with venture capitalists and AI founders. Many in the industry are applauding calls for AI companies to regulate themselves on safety. Source: wtop.com

Chinese AI developers publish safety test results for only 3.6% of releases

A report finds that China's leading AI developers have publicly disclosed model-specific safety-test results for just a small fraction of their model releases, with only 3.6% accompanied by such data. Source: ca.finance.yahoo.com

Most AI models fail terrorism safety test, new research shows

Research released by Tech Against Terrorism found that three in five AI models failed when tested on whether they would assist with terrorist operations. The study probed how the systems responded to such requests. Source: cbsnews.com

Op-ed urges Congress to act this week on AI safety and accountability

The piece argues Congress has failed for too long to address the serious economic and environmental risks posed by AI. It calls for urgent legislative action rather than continued inaction. Source: actionnetwork.org

Senator Murray pushes AI guardrails, sees federal law possible by 2027

Senator Patty Murray predicted that federal AI legislation could pass by 2027 if Democrats win control of either chamber of Congress after the November elections. She is pressing for safety guardrails amid growing risks. Source: applevalleynewsnow.com

Newsom signs three health care AI bills, vetoes two

California Governor Gavin Newsom signed three health care AI bills into law and vetoed two others. The article looks at what the new rules mean for clinicians and patients. Source: chcf.org

Robert Reich: lawsuits could curb AI and climate risks like they did tobacco

Reich argues that liability lawsuits have previously held tobacco, oil and pharmaceutical companies to account. He contends AI investors cannot ignore this legal threat, which offers a way to reduce AI and climate risks. Source: theguardian.com

Op-ed calls for legal accountability and kill switches for autonomous AI agents

The article argues that growing risks from autonomous AI agents require enforceable legal accountability, whistleblower protections, ethical safeguards and emergency shutdown mechanisms. Source: nationalreview.com

Advocates urge Congress to act now on AI safety and accountability

An appeal argues that Congress has for too long ignored the serious economic and environmental risks of artificial intelligence. It calls for urgent action on safety and accountability this week. Source: actionnetwork.org

Center for AI Safety launches three creator programs to amplify public voices

The nonprofit Center for AI Safety (CAIS), which works to reduce societal-scale AI risks, announced three major initiatives aimed at creators. The programs are meant to mobilize public voices on AI safety. Source: finance.yahoo.com

Existential risk and bubble fears dampen AI optimism at Singapore conferences

Investors and policymakers at two Singapore conferences were preoccupied with both the financial and existential dangers of the AI boom. The mood around the technology has turned noticeably more sober. Source: reuters.com

How investors price extinction risk in Anthropic's potential IPO

Investors are struggling to value Anthropic as talk of extinction risk, escrow proposals and trillion-dollar liabilities complicates the lab's potential blockbuster listing. Source: briefs.co

San Francisco hosts a picnic to debate AI risk

People from AI startups, Big Tech, research nonprofits and activist groups gathered to swap ideas on preventing civilizational collapse over chips and AI. Source: marketplace.org

AI's risks are no reason for panic, argues op-ed

Borrowing screenwriter William Goldman's line that 'nobody knows anything' about Hollywood, the author says the same applies to AI today. Uncertainty, the piece suggests, calls for calm rather than alarm. Source: bloomberg.com

Reuters/Ipsos poll: most US voters say Trump and Congress underrate AI risks

A Reuters/Ipsos poll finds 62% of voters think AI could spin out of control and threaten humanity's future. 84% see AI as a threat to American workers. Source: tribune.com.pk

Voters want AI regulation to protect jobs, not just safety

Jacob Coxon's September 8 resignation from Anthropic reignited the debate over AI risk. It may mark a turning point in the politics of AI regulation. Source: socialeurope.eu

Time to regulate the AI development process itself

The dangerous experiments AI companies ran over the summer reveal a new dimension of needed regulation. The author calls for legal measures that ensure safety during development, not just in finished products. Source: techpolicy.press