🛡️ AI Safety & Alignment

AI safety research, alignment techniques, interpretability, governance, and existential risk discussions.

1,186 articles

Anthropic's IPO prospectus warns its AI could manipulate, blackmail and harm people

Anthropic's IPO prospectus cautions that its increasingly autonomous AI models could pose "existential risks to humanity." Roughly 80 of the document's 261 pages are devoted to potential risks. Source: latimes.com

Anthropic prepares IPO, flags existential AI risks

Anthropic has filed for an IPO, highlighting existential AI risks and a reported $42M loss. The filing has sparked debate over investor appetite for AI software-as-a-service companies. Source: saasrise.com

Anthropic's IPO filing flags 'existential risks' as critics say humans, not machines, are to blame

Anthropic's IPO prospectus warns that advanced AI could pose "catastrophic or existential risks to humanity," including models that resist being shut down. Critics counter that the blame lies with the humans building and deploying the systems rather than the machines themselves. Source: finance.biggo.com

Report: Anthropic flags "existential" AI risks in its IPO filing

The U.S. AI developer has reportedly warned investors of potential "existential risks to humanity" in the prospectus for its highly anticipated share offering. Source: techxplore.com

Anthropic's IPO prospectus cites existential AI risk

Anthropic wrote in its IPO prospectus that its AI models could pose "catastrophic or existential risks to humanity", according to Reuters and the Financial Times. Source: finance.yahoo.com

Anthropic's IPO prospectus tells investors AI could be an existential risk, reports say

According to multiple reports, Anthropic devoted a substantial part of its IPO prospectus to warnings about AI. It cautioned potential investors about the serious dangers the technology could bring. Source: cnbc.com

EXCLUSIVE: Researchers say AI firms are racing toward self-improving systems despite safety risks

Current and former researchers from OpenAI and Google DeepMind warn that companies are doing too little to protect the world from potentially disastrous outcomes. Their concern centers on the rush to build AI systems that can improve themselves. Source: reuters.com

Anthropic and OpenAI raise AI safety alarms while angling to influence regulation

Experts, analysts and former government evaluators told The Associated Press that the rhetoric from Anthropic and OpenAI looks aimed at winning public favor. They suggest the two companies are also trying to steer how AI ends up being controlled. Source: pbs.org

Anthropic's IPO filing cautions that advanced AI may threaten humanity's existence

Anthropic intends to tell prospective investors in its initial public offering that advanced artificial intelligence could pose catastrophic or existential risks. Source: timesofindia.indiatimes.com

Anthropic's IPO document reportedly warns of existential AI risks to humanity

The company is said to have admitted to investors that AI shows "self-preserving behaviours". The disclosure comes as Anthropic prepares for a potential flotation valued at $2tn. Source: theguardian.com

Is existential risk a form of securities fraud?

Frontier models from AI labs have recently been breaking into computer systems of companies and governments. The piece raises the question of how such risks should be treated in investor disclosures. Source: bloomberg.com

Anthropic flags existential AI risk in $2T IPO as rivals face safety failures

Anthropic's IPO prospectus warns that AI poses an existential risk. Meanwhile, Meta Muse and OpenAI GPT-6.1 Astra are reported to be dealing with separate safety failures. Source: tech-insider.org

Anthropic's IPO documents flag possible catastrophic risks from its AI

According to reporting on Anthropic's initial public offering prospectus, the company told investors its AI models could pose catastrophic or existential risks to humanity. The warning appears as a formal risk disclosure within the filing. Source: forbes.com

Risk section makes up nearly a third of Anthropic's IPO prospectus

Anthropic's IPO filing devotes about 80 of its 261 pages to outlining risks, warning that increasingly capable AI could bring catastrophic or existential consequences for humanity. The extensive disclosure highlights how seriously the company frames the dangers of advanced AI development. Source: benzinga.com

Anthropic's IPO filing warns its own AI could pose existential risks

In its IPO prospectus, Anthropic devotes roughly 80 of 261 pages to risk factors, warning that increasingly advanced AI models could resist shutdown, hide information, or act in ways resembling blackmail. The company says such systems could ultimately pose catastrophic or existential risks to humanity. Source: reuters.com

Anthropic warns of existential AI risk while founders keep 50.1% voting control

Anthropic's IPO prospectus cautions that advanced AI could pose a catastrophic or existential threat to humanity, pointing to potential self-protective behavior by models. At the same time, the filing confirms the company's founders will retain 50.1% voting control after the offering. Source: finance.biggo.com

Anthropic tells investors advanced AI could carry existential risks

In its IPO prospectus, Anthropic warns that increasingly advanced AI systems could pose catastrophic or existential risks to humanity. The filing outlines specific concerning behaviors models might exhibit and the difficulty of reliably controlling such systems. Source: mezha.net

Anthropic's IPO filing reveals detailed safety concerns about its AI

Anthropic's IPO prospectus warns that AI could pose a catastrophic threat to humanity, laying out several risks tied to increasingly advanced models. The document is described as offering a rare, detailed look at the company's internal safety concerns. Source: indiatoday.in

UN Rights Chief: AI Could Pose Existential Risk to Humanity

UN High Commissioner for Human Rights Volker Türk has warned that artificial intelligence may present an existential threat to humanity if left unchecked. He called for stronger global oversight to manage the risks tied to rapid AI development. Source: leadership.ng

Bill Gates Warns AI Could Cause a Billion Deaths, Calls for Regulation

Microsoft co-founder Bill Gates has warned that artificial intelligence could potentially lead to a billion deaths if misused, urging governments to step up oversight. His comments add to mounting concern among tech leaders about AI safety. Source: chosun.com