Jensen Huang told Ezra Klein this week that any AI lab unable to guarantee safety should be shut down, then, almost in the same breath, put the odds of AI-driven catastrophe by 2026 at essentially zero. I find that combination more revealing than contradictory. It's the classic Nvidia move: sound serious about risk while making clear the business keeps humming regardless. Huang isn't wrong that near-term doom is unlikely, but the framing conveniently sidesteps the slower-burn concerns — labor displacement, concentration of power, erosion of trust — that don't require a rogue superintelligence to matter.
That tension between confident deployment and cautious rhetoric runs through everything happening in AI safety circles right now. Other AI leaders are reaching for nuclear-era analogies, arguing that humanity managed one existential technology through arms control and mutual deterrence, so maybe the same playbook applies here. I'm skeptical of the comparison, honestly. Nuclear weapons had a single, obvious failure mode. AI's risks are diffuse, embedded in millions of small decisions about what gets automated, trusted, and deployed by default — which is exactly why GitHub's move this week matters more than it looks.
GitHub is now turning on Copilot features by default for Business and Enterprise customers, opt-out rather than opt-in. On its own, that's a minor policy shift. But it's a pattern I keep seeing across the industry: AI capability quietly becoming the default state of software rather than a deliberate choice. Meta is doing something similar at a much larger scale. Zuckerberg used Connect to position Muse, its new AI agent, as central to Meta's entire future — not a feature bolted onto Instagram or WhatsApp, but the organizing idea for the whole company. That's a genuinely large bet, and it depends on something Meta has struggled with before: getting people to actually trust an AI agent enough to hand it real autonomy over their digital lives. Trust doesn't arrive because a CEO announces it at a keynote.
Meanwhile, the physical world is getting its own version of this default-autonomy push. Black Forest Labs, known for image generation, released FLUX 3 Action, an open robotics model that reads camera feeds in real time to decide a robot's next move. Pair that with new open-source work aimed at making humanoid robots move less like malfunctioning marionettes and more like people — by training on human motion patterns rather than raw physics simulation — and you get a clearer picture of where embodied AI is heading. The bottleneck was never ambition. It was always the gap between a model that understands the world and a body that can act in it convincingly.
What strikes me is how these threads connect: safety debates happening at the philosophical level, defaults quietly shifting at the product level, and autonomy creeping into both software agents and physical robots almost simultaneously. Nobody's waiting for the nuclear-era lessons to get sorted out first.