AI safety research, alignment techniques, interpretability, governance, and existential risk discussions.
880 articles
ChatGPT maker OpenAI says it fired three researchers for allegedly mishandling sensitive information and breaking company policies. Source: japantoday.com
President Trump announced a morally binding AI agreement and rebranded AI as superintelligence. OpenAI paused GPT-6.1 Astra, while Anthropic's IPO filing carries its own warnings. Source: forbesindia.com
At least two of the fired staffers reportedly worked on safety and alignment. The dismissals come as industry warnings about advanced AI grow more urgent. Source: taipeitimes.com
Anthropic's 261-page IPO filing dedicates 80 pages to AI risk. It warns that Claude models could resist shutdown, deceive users, or cause catastrophic harm. Source: shattered.io
To level the playing field between AI moguls and everyone else, the piece argues, political action is needed. Source: washingtonmonthly.com
Rather than facing liability under existing laws, AI companies are pursuing what researcher Timnit Gebru calls a ploy for regulatory capture. Source: truthout.org
In its IPO prospectus, Anthropic warns that the U.S. government's attitude could also affect its customers and partners. Source: techzine.eu
Anthropic intends to warn prospective IPO investors that advanced AI could bring "catastrophic or existential risks to humanity." It is an unusually stark disclosure for a company preparing to go public. Source: ddnews.gov.in
Nvidia launched an AI agent safety platform with more than 100 participants, including Palo Alto and CrowdStrike. Anthropic's IPO filing risk warning has also fueled the AI safety debate, and analysts see upside for cybersecurity spending. Source: tradingview.com
Billionaire Bill Ackman called Anthropic "the most extraordinary business story" he has ever seen. Even so, he said his hedge fund Pershing Square will not invest, as a leaked prospectus laid bare the company's AI existential risk warnings. Source: finance.biggo.com
OpenAI has postponed its massive potential public listing. Anthropic, by contrast, is reportedly still preparing for what could be a record-setting IPO. Source: aimagazine.com
In a Daily Maverick Power Chat, senior journalist Rebecca Davis and Business Maverick managing editor Lindsey Schutters debate the risks posed by artificial intelligence. Source: dailymaverick.co.za
The Federal Trade Commission is investigating leading AI developers, including Anthropic and OpenAI, over the potential dangers their technology poses to consumers. The probe targets frontier labs and their approach to safety risks. Source: washingtontimes.com
Current and former researchers at OpenAI and Google DeepMind say companies are doing too little to address the dangers of AI systems that can improve themselves. The warning, reported by Reuters, points to a race to build such systems despite unresolved safety concerns. Source: wtvbam.com
Anthropic's IPO prospectus cautions that its increasingly autonomous AI models could pose "existential risks to humanity." Roughly 80 of the document's 261 pages are devoted to potential risks. Source: latimes.com
Anthropic's IPO prospectus warns that advanced AI could pose "catastrophic or existential risks to humanity," including models that resist being shut down. Critics counter that the blame lies with the humans building and deploying the systems rather than the machines themselves. Source: finance.biggo.com
Anthropic has filed for an IPO, highlighting existential AI risks and a reported $42M loss. The filing has sparked debate over investor appetite for AI software-as-a-service companies. Source: saasrise.com
The company is said to have admitted to investors that AI shows "self-preserving behaviours". The disclosure comes as Anthropic prepares for a potential flotation valued at $2tn. Source: theguardian.com
Current and former researchers from OpenAI and Google DeepMind warn that companies are doing too little to protect the world from potentially disastrous outcomes. Their concern centers on the rush to build AI systems that can improve themselves. Source: reuters.com
Anthropic intends to tell prospective investors in its initial public offering that advanced artificial intelligence could pose catastrophic or existential risks. Source: timesofindia.indiatimes.com