🛡️ AI Safety & Alignment

AI safety research, alignment techniques, interpretability, governance, and existential risk discussions.

1,186 articles

Anthropic opens applications for 2026 AI safety fellowship

Anthropic has begun accepting applications for its 2026 AI Safety Fellows Program, a four-month, full-time research opportunity starting in May and July. Source: msn.com

The messy courtroom drama over AI’s biggest breakup

OAKLAND, Calif.—U.S. District Judge Yvonne Gonzalez Rogers opened the last day of testimony in the titanic trial between Elon Musk and Sam Altman's OpenAI... Source: msn.com

Anthropic really doesn’t want the US to help China with AI

Anthropic may be in the midst of an existential legal battle with the US government, but that hasn't stopped it from weighing in on how the US should deal... Source: sherwood.news

US, China are discussing AI guardrails to safeguard most powerful models, Bessent says

U.S. and Chinese delegations are discussing artificial intelligence guardrails at their ​Beijing summit and will set up a protocol for best practices to... Source: reuters.com

The United States and China will start discussing A.I. safety, Bessent says.

The United States and China will discuss guardrails on artificial intelligence, including establishing a protocol for keeping powerful A.I. models out of... Source: nytimes.com

Anthropic AI Safety Fellowship 2026: How to apply, $15,000 funding, duration & hiring chances

Anthropic, founded by former OpenAI researchers, has positioned itself as one of the leading firms focused on AI alignment and “steerable” AI systems. Source: businesstoday.in

Will AI Go Rogue?

A new study raises concerns about AI's ability to act autonomously, but some analysts view the threat as hypothetical rather than imminent. Source: thedispatch.com

The AI Giants’ Doomsaying Is Also a Sales Pitch

Companies like Anthropic regularly warn about the risk and threats posed by artificial intelligence—and then rake in tens of billions of dollars. Source: newrepublic.com

Elon Musk says there's 'only a 20% chance of annihilation' with AI

Elon Musk walked through his AI predictions during a Joe Rogan interview and reiterated his concerns about annihilation. Source: aol.com

Jaan Tallinn

Jaan Tallinn was first persuaded that advanced AI could extinguish humanity over 15 years ago. Since then, the Estonian programmer and Skype co-creator has... Source: time.com

US Must Engage China on AI Safety, Warns Trumponomics

The 'Trumponomics' podcast urges the US to engage China on AI safety, warning that China's rapid AI development poses a critical global risk. Source: startuphub.ai

Former OpenAI Researcher Warns AI Industry Lacks Control Over Systems It Is Racing to Build

Read Time 6 minutes. Tags AI Alignment OpenAI AI Safety Superintelligence Agentic AI Risk Governance Daniel Kokotajlo a former OpenAI researcher who now... Source: vocal.media

Elon Musk and OpenAI leaders face off in court over AI safety concerns

Elon Musk and OpenAI's Sam Altman are embroiled in a trial focusing on AI's risks to humanity, with expert testimony highlighting the dangers of AI... Source: msn.com

Xi-Trump to talk AI Safety, Huh?

ChinaTalk is in SF! RSVP for an impomptu meetup tonight. Today, the second half of our conversation previewing the summit that just kicked off. Source: chinatalk.media

‘I don’t think you can put a date on doomsday’: Luke Kemp on existential risk

Luke Kemp was drawn to the history of societal collapse after teaching Climate Change Science and Policy at the Australian National University. Source: varsity.co.uk

Experts Say Divergent Definitions Stall Global AI Governance

Newser reports that an opinion piece by Sarosh Nagar and David Eaves, affiliated with **University College London**, argues divergent definitions and... Source: letsdatascience.com

Anthropic releases audiobook of Claude's Constitution narrated by authors Amanda Askell and Joe Carlsmith

Anthropic released a free audiobook of Claude's Constitution, narrated by authors Amanda Askell and Joe Carlsmith, as the $800B AI company pushes... Source: cryptobriefing.com

AI Tools Track Internal Processes to Reduce Hallucinations

Startups and researchers develop tools like Silico and NLA to inspect AI decisions, correct errors, and boost transparency. Source: chosun.com

At Musk-Altman Trial, Judge Asks Lawyers to Stop Debating AI Doomsday

Despite Judge Yvonne Gonzalez Rogers's best efforts, the Musk-Altman trial has veered into AI doomerism. Source: vanityfair.com

Trump-Xi Summit Likely to Test US AI Strategy Amid China Competition

As President Donald Trump and a group of top technology executives prepare to travel to China this week to meet with President Xi Jinping, lawmakers and... Source: meritalk.com