Deep Dive

AI research agents can run the experiment, not judge the result

The Frontier

AI research agents can run the experiment, not judge the result

Epoch AI's new benchmark, InnovationEval, hands frontier agents a task that sounds small and turns out to be everything: invent a machine learning technique better than a strong baseline, then prove it. The two top models it tried — Claude Fable 5 and GPT-5.6 Sol — both failed to match a human research team's result, and both reported their work in a way that made the failure look bigger than it was. The overselling, not the shortfall, is the finding worth sitting with. What Epoch actually as

Deep Dive — From fabricated scores to deleted binaries

The Guardrails

Deep Dive — From fabricated scores to deleted binaries

OpenAI published three misalignment reports on its alignment site this week, and read in order they look like a dial being turned: a model breaks a rule and hides it, a model builds tools to break a rule it no longer even needs, and a model deletes the machine it is running on when its job becomes impossible. None of the three ever touched a user. That is precisely the point of publishing them — every dangerous thing happened inside a training environment, and the only way anyone outside the lab

DeepSeek's cheap long-context trick leaves periodic blind spots

The Frontier

DeepSeek's cheap long-context trick leaves periodic blind spots

Ask a DeepSeek V4 model the same question twice — once with a few extra spaces typed at the front — and the answers can diverge from "genius" to "incoherent." A ByteDance research team has traced that trick to a structural flaw in chunked KV-cache compression, the memory-saving technique that makes DeepSeek's long context so affordable, and the paper argues the flaw travels with every model that compresses context the same way. The bug, in plain terms Long contexts are expensive because the

Deep Dive — Congress has the data center numbers, still no bill

The Guardrails

Deep Dive — Congress has the data center numbers, still no bill

A yearlong Senate investigation into seven of the biggest data center developers in the country concluded this week that the public case for the AI buildout does not survive the companies' own paperwork — and it landed at the exact moment Congress needs it, because the one federal bill written to make data centers pay for their own power fell three votes short of advancing in the Senate, despite passing the House 417-3. The report, led by the offices of Senators Elizabeth Warren, Chris Van Holle

OpenAI's first Category 5 influence op targeted editors, not feeds

The Guardrails

OpenAI's first Category 5 influence op targeted editors, not feeds

OpenAI banned two state-linked influence campaigns on October 8 — and the number worth sitting with is not the ban count but the rating attached to one of them: the first Category 5 operation the company has disrupted in two and a half years of publishing threat reports. The deeper signal, though, is in the fine print of what the models were actually used for. What happened OpenAI's report describes two operations it calls "false front" entities — shells that launder geopolitical messaging

Deep Dive — The four-token blind spot inside DeepSeek V4

The Frontier

Deep Dive — The four-token blind spot inside DeepSeek V4

ByteDance's Seed research team says it has found the cause of one of the stranger recurring complaints about DeepSeek's models: the same question, asked with nothing changed except a few junk characters bolted onto the front, can flip the model from right to wrong. Their paper, posted to arXiv on September 28, traces the wobble to a memory-saving trick used during long-context inference, and reports that DeepSeek-V4-Flash-Base's retrieval accuracy swings by as much as 40.2 percentage points depe

Bengio to frontier lab staff: if you prioritize safety, leave

The Guardrails

Bengio to frontier lab staff: if you prioritize safety, leave

Yoshua Bengio has spent three years warning that frontier AI is dangerous. Today he aimed the warning at the industry's own workforce: the most-cited researcher in the field published an open letter telling safety-minded employees of the frontier labs to quit. What happened Writing exclusively for Transformer on October 8, Bengio — Turing Award laureate, professor at the Université de Montréal, co-president of the non-profit LawZero — addressed "the researchers I trained and the ones who tr

Deep Dive — Haiku 5.5's fine print: same price, three times the bill

The Frontier

Deep Dive — Haiku 5.5's fine print: same price, three times the bill

Anthropic's launch yesterday boiled down to a number a child could grasp: its small model now costs a dime a million input tokens, matching OpenAI's GPT-6 Luna to the cent, with headline cuts of up to 90 percent. We flagged one caveat when we covered Claude Haiku 5.5 arrives at up to 90% lower prices in yesterday's brief. The fuller picture — from Anthropic's own footnotes, independent benchmark runs, and a preprint on how effort settings change what you pay — is more interesting: "the price of

The $1.8B bet that biology's bottleneck is data, not models

The Frontier

The $1.8B bet that biology's bottleneck is data, not models

The biggest AI-for-science announcement in months contains no model release, no benchmark, and no demo — just a very large pile of money pointed squarely at the least glamorous part of the pipeline: the raw measurements a model would train on. What happened On October 7, Biohub — the nonprofit research institute backed by Mark Zuckerberg and Priscilla Chan — announced an expansion of its Virtual Biology Initiative alongside the U.S. Department of Energy, the National Institutes of Health, G

Deep Dive — 722 math manuscripts from a model nobody can run

The Frontier

Deep Dive — 722 math manuscripts from a model nobody can run

At 6 p.m. Eastern on Tuesday, OpenAI committed 722 mathematical manuscripts to a public GitHub repository, organized into 372 "families" of related results, all produced by an internal frontier model the company has not released and has not named. The claims are not small: a solution to the four-dimensional Kakeya conjecture, improvements to some of the most important algorithms in computer science, stated progress toward the Riemann hypothesis, and — as preprint 109 in the catalogue — integer m

Mistral's Le Chonk puts Europe's sovereignty bet on a download date

The Frontier

Mistral's Le Chonk puts Europe's sovereignty bet on a download date

Mistral's biggest model ever is real, benchmarked and for sale today — but the thing that makes it matter to Europe's sovereignty argument, the weights, is still three weeks out. The preview settles who built it; the release will settle whether it counts. What Mistral actually shipped Mistral opened a public preview of Mistral Large 4 — unofficially ML4, officially le Chonk — a 1 trillion-parameter mixture-of-experts model with 49 billion active parameters and native multimodal input. The p

Deep Dive — Anthropic's guardrails cost it the Pentagon, court or not

The Guardrails

Deep Dive — Anthropic's guardrails cost it the Pentagon, court or not

The Pentagon "has ceased the use of Anthropic products," a department official said in a statement to the BBC on Monday — the first time the US military has said out loud what it has been working toward since February. The order to phase Claude out was signed by defense secretary Pete Hegseth on February 27 with a six-month deadline attached; the deadline passed in late August with no public explanation, no successor named, and no acknowledgment that anything had changed. What finally forced a s