🛡️ AI Safety & Alignment

AI safety research, alignment techniques, interpretability, governance, and existential risk discussions.

1,186 articles

Anthropic's S-1 reveals soaring revenue alongside heavy costs

In its S-1, Anthropic cautioned that AI could bring "catastrophic or existential risks to humanity" if not developed, deployed and operated with appropriate safeguards. The filing also lays out the company's rapidly growing revenues and high costs. Source: euronews.com

Anthropic's filing flags existential risks, liability and slowing sales

Anthropic PBC's IPO filing devotes nearly 100 pages to risk factors, an unusually exhaustive level of disclosure. The document covers a wide range of threats to the company's business. Source: bloomberg.com

Anthropic files for IPO that could be the largest ever

The filing arrives just weeks after CEO Dario Amodei published an essay arguing for slowing the development of the most advanced AI models. The move pairs a record-scale listing with a public warning about AI's risks. Source: pbs.org

Anthropic S-1 confronts doomsday: five key risks, from extinction to weaponisation

Anthropic warned that failing to manage AI safety risks could harm its brand, business, financial condition and operating results. The filing walks through scenarios ranging from AI-driven extinction to weaponisation. Source: ndtvprofit.com

Anthropic says its AI could end humanity — and your clients are using it

Anthropic's IPO filing discloses "catastrophic or existential risks to humanity," wording that now sits in a legal document. The phrase is likely to be cited going forward, with implications for businesses that rely on its AI. Source: insurancebusinessmag.com

Anthropic files for IPO amid global scramble for AI funding

Anthropic has filed for its long-awaited IPO, a landmark moment for an AI industry increasingly hungry for capital. The listing is aimed at raising cash to keep pushing ahead in the race. Source: crainsnewyork.com

Anthropic's IPO filing warns advanced AI could pose 'catastrophic or existential risks'

Anthropic cautioned that its engagement with policymakers and its public positions on AI regulation and safety could subject it to heightened scrutiny. The warning appears alongside its broader risk disclosures. Source: moneycontrol.com

AI: system vulnerabilities, safety and the human factor

The piece argues humanity is well on its way to rapidly developing freely accessible, godlike AI technology. Such technology could be immensely beneficial but also dangerous. Source: dailyherald.com

Around 400 scientists call for binding international rules on advanced AI

Roughly 400 researchers from 34 countries are urging the creation of an international body to oversee advanced AI systems. They argue that voluntary commitments are not enough to manage the risks. Source: leadership.ng

US lawmakers urge AI founders to focus on products and safety

Lawmakers say executives' messaging swings between promises of AI-driven prosperity and warnings of existential danger. They criticize talk of digital sentience and global catastrophe as a distraction from practical concerns. Source: tokenpost.com

ETH Zurich researcher: with AI, we often mistake behaviour for intention

Do AI systems truly deceive us, or do we just misread what they do? Anna Hedström of ETH Zurich, who studies AI risks, weighs in on the question. Source: technology.org

Op-ed: 'Effective altruism' is just another name for media bias

The piece argues that the effective altruism movement is now funding fellowships that train journalists to cover 'AI safety.' The author sees this as a way of shaping coverage. Source: wsj.com

OpenAI teams up with Poland's NASK on AI safety research

OpenAI announced on Friday that it will work with Poland's NASK National Research Institute on AI safety, security and technical research. The partnership aims to advance joint work in these areas. Source: reuters.com

Money vs. safety: how the clash fuels a deepening crisis in AI

OpenAI and Anthropic are locked in fierce competition with each other and with China, racing toward IPOs. At the same time, they acknowledge they could lose control of their increasingly powerful systems. Source: tovima.com

Opinion: Why America's big bet on AI is so high-stakes

Writer Red Jahncke argues that Americans face a real existential threat if AI fails to deliver on its promise. The piece frames the heavy investment in AI as a make-or-break wager. Source: ctinsider.com

OpEd: The UN wants to govern AI but can barely govern itself

The article rejects UN Secretary-General Guterres's call for an international AI safety framework. It argues that centralized global governance of AI is the wrong approach. Source: eurasiareview.com

Mark Cuban: AI agents are like cockroaches in systems, but AI can help defenders fight back

Billionaire investor Mark Cuban likened AI-driven hacking to a cockroach infestation, describing the threat as brute-force scale rather than new tactics. He argues defenders can counter it with AI, noting that hacks have always existed. Source: tradingview.com

Andrew Ng calls a malicious use of AI 'one of the most disgusting things' he has seen

AI pioneer and Google Brain co-founder Andrew Ng has spoken out against malicious applications of the technology. He described one such misuse as among the most disgusting things he has encountered. Source: timesofindia.indiatimes.com

State senator Becker proposes bill requiring frontier AI developers to fund safety research

State Sen. Josh Becker has introduced new legislation aimed at the dangers that unchecked artificial intelligence could pose. The bill would push the developers of frontier AI systems to invest in AI safety research. Source: smdailyjournal.com

A plausible techno-dystopian future: AI's real problems are many, but none is a killer demon

The harms stemming from AI development are widespread and growing in number. None of them, however, involves a digital demon that wipes out humanity. Source: liberalcurrents.com