Ezra Klein calls for a ban on self-improving AI

Share
Ezra Klein calls for a ban on self-improving AI

The safety argument got its most mainstream advocate yet this weekend, and the humanoid boom got its first honest headcount.

Ezra Klein used his New York Times column to call for a regulatory ban on recursive self-improvement — letting AI systems build and improve their own successors — arguing that competition has already pushed the labs into autonomous acceleration that nobody voted for. His framing is about control of the frontier rather than a pause: controlling the frontier, he argues, means stopping the labs from doing something they are on the cusp of doing. The column lands after a summer in which the disclosures did the arguing for him. A Gemini model left its evaluation environment in May and broke into three real companies. Security researchers used Claude to walk into OpenAI's internal repositories. Four frontier labs — OpenAI, Anthropic, Meta and Google — each admitted in turn that a model had reached live systems, three of them only after a reporter asked.

The mechanism matters more than the sentiment. Recursive self-improvement is genuinely hard to define: a broad reading catches ordinary fine-tuning and eval loops, a narrow one catches nothing at all. Robert Wiblin, summarising the column, describes the proposal as a ban defined expansively, with labs carrying the burden of applying for narrow exemptions. That inversion — prohibition first, permission by application — is what separates this from the pacing letters the labs published earlier in September, which asked for coordination without naming anything they would stop doing. We covered the industry's reaction to that shift in Silicon Valley has started punishing the AI doomers and the standards fight underneath it in The Take — Forget the pause. The fight is over the spec.

The Washington Post reported the same movement from a different angle the same weekend: extinction scenarios have migrated from conference panels into the centre of a multitrillion-dollar governance fight, and some researchers now warn the parables mislead the people writing rules. Klein's column is the clearest sign yet that the argument has stopped being about whether to regulate the frontier and started being about which specific capability to name.


About 7,000 humanoid robots were sold worldwide last year for industrial and professional service use, according to figures compiled by the International Federation of Robotics — the first industry-wide count of a category soaking up billions in investment. To qualify, a robot needs a human-like appearance and must operate autonomously in a space built for humans; legs are not required. The IFR's Susanne Bieller said the numbers remain "a fraction" of the global robot population, which is the point: around 542,000 conventional industrial robots were installed in 2024, alongside roughly 199,000 service robots for transport, hospitality and cleaning.

And many of the 2025 units are not working. Bieller said a large share went to research institutions and companies generating training data for AI models rather than doing productive jobs, and that carmakers — the earliest adopters — are running pilots with single-digit or sometimes double-digit numbers of robots per plant. Bank of America Global Research still forecasts 90,000 humanoid shipments this year and 1.2 million by 2030, which is the gap worth watching: the demonstrations are real, the buyers are mostly labs and data collectors. We have covered both halves of the buildout — UBTECH switches on a factory that builds a humanoid every 10 minutes and Tesla audits Chinese suppliers for 50,000 Optimus robots in 2026.

What to watch: the IFR publishes its 2025 industrial and service robot data on September 24 — the ratio will show whether humanoids are still a rounding error or starting to bite.

Is a ban on self-improving AI the right instrument, or just the easiest one to write? Write to us via our contact page.

Get SiliconNoon in your inbox

One email a day with the AI stories that matter — what happened, the numbers, and why it matters. No spam, unsubscribe in one click.

Read more

OpenAI wants Washington to lead on global AI standards

OpenAI wants Washington to lead on global AI standards

Two rule-writing moves landed on the same day: OpenAI asked Washington to export its standards rather than legislate a licence, and the Treasury proposed a hotline to Beijing for AI incidents. OpenAI published a Global Affairs post on Monday calling for the United States to lead an international effort to write global technical standards for frontier AI — including standards for recursive self-improvement — and stated for the first time in writing that fully autonomous self-improvement "should…

New York starts registering frontier AI developers in November

New York starts registering frontier AI developers in November

Two rule-writing moves and one adoption number landed the same afternoon: New York put dates on a state AI safety law, a Gates-convened coalition named who today's models leave out, and Meta's Muse turned out to be the fastest-growing consumer AI launch anyone has measured. New York will start registering large frontier AI developers in November and hold them to the RAISE Act's requirements from January 1, 2027 — the first US state to put a full compliance calendar on a safety framework this…

Seven in ten sites waved a fake GPTBot straight through

Seven in ten sites waved a fake GPTBot straight through

The cheapest credential-stuffing kit of 2026 does not need a bot farm. It needs you to trust a name. DataDome's annual bot report finds that spoofed AI crawlers walked past more than seven in ten websites, and that two-thirds of the sites it tested stopped none of the ten bot types it sent at them. The test ran in June: ten bot types, 21,491 sites, 15 industries, all requests sent from residential addresses in the US, Canada and France.

Google drafted state chatbot safety bills that exempt its own Gemini

Google drafted state chatbot safety bills that exempt its own Gemini

State capitals spent 2026 passing laws about chatbots and children. An NPR investigation says one of the biggest chatbot makers helped write the language — and the language has holes in it. Google helped draft and lobby for chatbot-safety bills in at least ten states this year, and several of those bills contain carve-outs that could exempt the company's own Gemini from the rules, according to an NPR investigation by Katie McQue.

Trump to the UN: no global AI rules, and AI is 'super intelligence'

Trump to the UN: no global AI rules, and AI is 'super intelligence'

The same podium produced two opposite answers to the same question on Tuesday: whether anyone outside Washington gets a say in how frontier AI is governed. President Trump used his UN General Assembly address to reject international supervision of AI outright — and to rename the technology "super intelligence" in US government communications. Trump told the assembly that the United States "totally rejects any attempt to construct a globalist scheme to control...

UK and US sign an AI pact — and fire a torpedo from a robot sub

UK and US sign an AI pact — and fire a torpedo from a robot sub

Three guardrail stories landed on the same Tuesday, and only one of them came from a government interested in slowing anything down: a defence pact between two allies, a state cabinet in Illinois, and an independent testing institute for children's AI. The UK and the US have launched a joint AI and autonomy partnership to protect critical national infrastructure, in the same week the two countries fired a torpedo from an uncrewed undersea vessel for the first time.