Tagged: Safety

271 articles

Goodfire – Weekly Recap

Goodfire is an AI safety and tooling company focused on improving the reliability and controllability of large language models, and this weekly recap... Source: tipranks.com

RVPO: Risk-Sensitive Alignment via Variance Regularization

Current critic-less RLHF methods aggregate multi-objective rewards via an arithmetic mean, leaving them vulnerable to constraint neglect:… Source: machinelearning.apple.com

Mythos vulnerability scare forces Trump White House to revive pre-release AI safety testing

Trump White House advances AI pre-release testing executive order after Anthropic Mythos vulnerability demo, with CAISI voluntary deals with Google, Source: startupfortune.com

Artificial intelligence revives a cold-war-style dilemma

Donald Trump and Xi Jinping may discuss artificial intelligence cooperation when they meet, as both America and China grapple with AI safety risks and... Source: economist.com

Common Sense Media launches Youth AI Safety Institute to test AI risks for children

Common Sense Media launched the Youth AI Safety Institute to independently test AI tools, publish consumer guides, and set safety standards that protect... Source: mezha.net

Inside Opal’s attempt to reduce AI’s ‘alignment tax’ for marketers

The planning platform's new AI copilot, Gem, is designed to align campaign data with overall strategy and help teams understand results faster. Source: marketingdive.com

Demis Hassabis on AI Safety and Future

DeepMind CEO Demis Hassabis discusses AI safety, AGI, and the future of scientific discovery with Lex Fridman. Source: startuphub.ai

Elon Musk Testifies in OpenAI Trial, Raises AI Safety Concerns

Oakland: Elon Musk testified for over seven hours across three days in a trial in Oakland, California, concerning OpenAI's future, framing his lawsuit as a... Source: newsmobile.in

AI Safety Expert Warns of Existential Risks

AI safety expert Dr. Eleanor Vance warns of existential risks from rapidly advancing AI, urging global cooperation and robust governance. Source: startuphub.ai

Goodfire’s New Tool Lets Engineers See Inside a Language Model While It Is Still Being Trained and That Changes Everything About AI Safety

San Francisco startup Goodfire released Silico on April 30, a mechanistic interpretability tool that lets researchers inspect and modify large language... Source: startupfortune.com

Scott Bessent Blasts Bernie Sanders For Hosting Chinese Scientists For Discussions On AI Threats: Like 'Channeling' Hugo Chavez On How To Run Economy

On Monday, Treasury Secretary Scott Bessent criticized Sen. Bernie Sanders' (I-Vt) upcoming Capitol Hill AI safety forum, arguing that America's greatest AI... Source: yahoo.com

OpenAI's Altman: AI Safety is Not Just About Existential Risk

OpenAI CEO Sam Altman discusses AI safety beyond existential risks, focusing on bias, job displacement, and the need for proactive measures. Source: startuphub.ai

The AI safety movement needs normies

A broader base may be the only way for the AI safety field to get what it wants. Source: transformernews.ai

AI safety PACs should be more transparent about who’s funding them

One of the central purposes of campaign finance law is to provide voters with transparency over who is trying to sway their votes. One of the central policy... Source: transformernews.ai

Applications are Open for the Anthropic Fellows Program -Apply By 26 April 2026

The Anthropic Fellows Program is a structured research initiative created by Anthropic to develop emerging talent in AI research, engineering, and AI safety... Source: globalsouthopportunities.com

Sex researcher Aella wants creators to confront the AI apocalypse

Aella is a lot of things to a great many people. She's a data scientist, a sex-research Substacker, and an orgy organizer. And now she is an AI safety... Source: sfstandard.com

TRIGGERnometry: w/ AI Expert Dr Roman Yampolskiy (Transcript)

Editor's Notes: In this episode of Triggernometry, Dr. Roman Yampolskiy, a leading expert in AI safety, presents a sobering argument for why he believes... Source: singjupost.com

Anthropic opens AI safety fellowship with Rs 3 lakh weekly stipend, apply by April 26

Anthropic has opened applications for its AI Safety Fellows Program for 2026 cohorts beginning in May and July. The fellowship offers funded research... Source: msn.com

AI Safety Fears: A Skeptic's View

Bloomberg's Par-Miyol Olson discusses the debate around AI risks, questioning the focus on existential threats and highlighting the need for practical... Source: startuphub.ai

AI Alignment Is Impossible - by Matt Lutz - Persuasion

Artificial Intelligence presents a number of risks and challenges, the most important of which is existential risk. That is a fancy way of saying that AIs... Source: persuasion.community