Shut Up or Shut Down? Amodei, Altman, Musk & the Great AI Freakout

Something unprecedented happened yesterday. Sam Altman, Elon Musk, and Dario Amodei — rivals who rarely agree on anything — all called for an AI slowdown. It came after more and more doomsday warnings from experts which seem to have finally woken Congress up to AI’s potentially existential threat. Axios even claimed that Speaker Mike Johnson is considering canceling the House recess to force members back to the Capitol to discuss the crisis. This seems to have been the week that the AI zeitgeist has finally shifted. Seven days that have changed the AI world.

 

For That Was The Week publisher Keith Teare, it’s time to shut up or shut down. While he remains a sceptic about the autonomy of AI agents, he recognizes its potential danger. “The minute there is recursive self-learning, there’s no speedometer. It’s either on or off,” he says. “You either control it or you don’t.” In terms of AI policy, he argues, you can’t be half-pregnant. Either leave it alone or flip the off switch. Anything else fudges the issue and allows slippery characters like Sam Altman and Dario Amodei to pursue their own agenda.

 

I don’t disagree. The real world, however, is forever half-pregnant. Investment in AI and the upcoming Anthropic IPO are the driving force of the economy. So AI’s existential threat isn’t just to “humanity.” It’s also to American prosperity, a politically existential threat (thus Trump’s opposition to any regulation). So, yes, this was the week that the AI zeitgeist shifted. The die is, indeed, cast. But it’s only the beginning rather than the end of this remarkable story. Pass the popcorn. Predicting the future might be a fool’s game, but it’s certainly going to get real interesting.

 

Five Takeaways

 

•       Calling BS on the Slowdown. The week’s convergence was genuinely new — a Dario Amodei essay warning that humans could lose control, Altman and Musk jumping aboard, all three major papers leading with it, Congress “waking up,” and an Axios scoop that Speaker Mike Johnson is being urged to cancel the House recess. Keith’s diagnosis is withering: it illustrates “the weakness of AI leadership,” swayed by a six-week employee who resigned, wrote an essay, and went on TV. His deeper claim: there is no such thing as AI as an independent actor, so the entire scare is misconstrued — “AI is not dangerous, period.” What the slowdown talk really represents, he argues, is the economic self-interest of incumbents in containing open-source AI — rules that prevent others from playing. Is anything new, Andrew pressed? “The heat is ramped up a notch. That’s about it.”

•       No Speedometer. The episode’s logical core. If you believe recursive self-improvement can’t be controlled by humans, and that the agents it produces will be malicious, then slowing down is incoherent — “the only logical thing is not to slow it down, but to shut it down”: no Anthropic, no IPO, a ban. “The minute there is recursive self-learning, there’s no speedometer. It’s either on or off.” Scott Bessent’s speech — the week’s most prescient, in Keith’s view — made the practical version: recursion can’t be stopped, and 3,500 mostly open-source models already sit in the Hugging Face store. Stephen Witt’s NYT taxonomy (shut it down, air-crash investigations, monitoring, the kill switch — with his closing COVID-epidemiologist analogy) gets respect but fails Keith’s test: none of it solves the problem if the problem is real. In AI policy, as Andrew’s intro has it, you can’t be half-pregnant: either leave it alone or flip the off switch — anything else fudges the issue. His counter-gameplay: for AI to threaten humanity it needs biological or nuclear weapons, and that chain of events is “fantastical.” Andrew’s retort — so was hijacking planes into the World Trade Center.