Tagged: Safety

271 articles

Anthropic's IPO filing flags a key AI safety alarm as AI speeds up its own research

In its new IPO filing, Anthropic says AI is now accelerating AI research itself, to the extent that it trips one of the company's core safety alarms. The disclosure arrives just days before the planned public debut. Source: finance.yahoo.com

Experts Say the AI Safety Debate Is Off Track and Name the Real Dangers

We asked ten experts what truly threatens us, and they point to nuclear catastrophe and the fallout from the US–China power struggle, including espionage. A Skynet-style takeover, they say, is not worth panicking over. Source: wired.com

Trump touches on AI safety and China in 60 Minutes interview

In a 60 Minutes interview, Trump said the DOJ is handling AI safety risks and claimed China has 'no guardrails'. Source: theverge.com

Democratic 2028 hopefuls huddle with AI safety advocates in San Francisco

JB Pritzker, Rahm Emanuel, Cory Booker and Ro Khanna met with AI safety advocates in San Francisco, according to an exclusive from POLITICO's Decoded. The gathering offers an early look at how potential 2028 Democratic contenders are thinking about AI policy. Source: google.com

Five Democrats set to reshape the AI safety debate in Washington

The Democrats' midterm sweep sends five AI safety advocates to Congress. Their arrival signals a possible push for tougher regulation of the tech industry. Source: google.com

White House control over AI safety staff is a dangerous mistake, op-ed argues

The commentary argues that when people auditing frontier AI models answer directly to political handlers, the result is no longer a genuine safety check. It warns that political oversight undermines the independence such audits require. Source: geosirius.ifz.ru

Looking Inside AI: Where Mechanistic Interpretability Stands for Safety

Neural networks may turn out to be among the most consequential artefacts in human history. As these systems grow more capable and autonomous, understanding what happens inside them becomes ever more important for AI safety. Source: google.com

Commentary ties AI backlash and market jitters to Nvidia's $3.2T valuation

A video roundup links a political backlash against AI in Congress and Texas to pressure on Nvidia and Big Tech, citing a $3.2T valuation. It also touches on Sam Altman and Elon Musk's reactions and the ongoing debate over AI safety versus acceleration. Source: youtube.com

Hassabis: Google was probably wrong to hold back LaMDA

Demis Hassabis says Google was probably mistaken to hold back LaMDA. The piece draws 10 lessons for founders and investors on launch bars, objective functions and AI safety. Source: the-ai-corner.com

Good news and bad news on AGI and climate change

Since early September, when Jacob Coxon resigned from Anthropic over AI safety concerns, a wave of dire warnings has followed. The piece weighs the good and bad news on AGI and climate change. Source: google.com

AGI and climate change: the good news and the bad news

Since Jacob Coxon quit Anthropic in early September over AI safety concerns, a flood of dire warnings has followed about what lies ahead. The piece weighs the encouraging and troubling sides of AGI and climate change. Source: techpolicy.press

Opinion: untying the Gordian knot of AI alignment

Industry insiders and experts agree that global regulation is needed so AI serves human well-being. The author argues it is time to actually make it happen. Source: commondreams.org

Banks Face New AI Safety Risks as Agentic Finance Approaches

At a major industry summit, finance executives described an coming era of agent-to-agent banking. They also cautioned about the safety risks AI could bring. Source: scmp.com

China to roll out AI safety rules covering model development and deployment

China plans to introduce extensive AI safety standards spanning how models are developed and deployed. Beijing is looking to strengthen its oversight of the technology. Source: macaudailytimes.com.mo

Altman: losing control of AI is "absolutely" possible, no lab has solved alignment

OpenAI CEO Sam Altman says it is absolutely possible for AI to slip beyond human control and that no lab has yet solved alignment. He says OpenAI has paused training runs until safeguards are in place. Source: finance.biggo.com

China prepares sweeping AI safety standards after global failures

China intends to introduce a broad set of standards governing the safety of artificial intelligence, covering everything from development to deployment. The move follows safety lapses seen around the world and signals Beijing's push to shape how AI is regulated. Source: taipeitimes.com

Repligate says AI safety community has lost its appeal

In a post on X, Repligate said this is perhaps the main reason the entire AI safety community has become much less interesting to them over the past few years. The comment was highlighted by Techmeme. Source: techmeme.com

LeCun's 109M JEPA model beats 72B LLMs at image-text alignment

A new paper by Yann LeCun and Randall Balestriero shows a 109M-parameter JEPA model outperforming 72B LLMs on image-text alignment. It does so while using 42 times less training data. Source: startupfortune.com

Hackers jailbreak top AI models in a global effort to expose their weaknesses

The FT profiles Pliny the Prompter, who says it usually takes him around 30 minutes to break even the world's most powerful AI models. His work is part of a wider global push to jailbreak frontier systems. Source: ft.com

Warren blasts Trump's voluntary AI safety deal with tech CEOs

Senator Elizabeth Warren criticized Trump for letting AI companies regulate themselves. She warned that voluntary safety commitments are no substitute for real rules. Source: benzinga.com