The Frontier

New models, papers, and benchmarks

AI 101 — What is LLM-as-a-judge?

The Frontier

AI 101 — What is LLM-as-a-judge?

If you read a week of AI news, you'll notice almost nobody grades models by hand any more. When a lab says its new model is better at writing, summarising or handling customers, the number usually came from another AI. An LLM judge is a language model used to grade the work of another model — or of your own AI feature — when no piece of code can decide whether the answer was good. The industry term is LLM-as-a-judge, and the job is simple to state: read a question and an answer, then return a s

A 27B security model from Alibaba beats the frontier labs on CyberGym

The Frontier

A 27B security model from Alibaba beats the frontier labs on CyberGym

A 27-billion-parameter security model that Alibaba fine-tuned itself now sits above Google's and OpenAI's purpose-built cyber models on UC Berkeley's vulnerability benchmark. Separately, the platform vendors started selling the tooling to explain what agents actually do — which is the question the first story is really about. Alibaba Security's XekRung-1.5-27B-Preview took the No. 1 row on CyberGym's model leaderboard with an 88.9% success rate at reproducing real vulnerabilities — 34.39 points

Insilico's AI-designed drug enters Phase III — a first for the field

The Frontier

Insilico's AI-designed drug enters Phase III — a first for the field

A drug whose target was found by AI and whose molecule was designed by AI is now in a late-stage trial — and the registry, not the press release, is what makes it a milestone. The same day brought a machine-checked maths result from a team of agents, and a brain-implant round with an unusual lead investor. Insilico Medicine has begun dosing patients in a 320-person Phase III trial of rentosertib, an oral treatment for idiopathic pulmonary fibrosis — the first drug with both an AI-identified tar

An LLM that edits molecules instead of drawing them

The Frontier

An LLM that edits molecules instead of drawing them

Nature Machine Intelligence has published a Peking University method that reframes molecular design as editing rather than generation — and the numbers suggest the framing is the contribution. SynCraft, from Junren Li and Luhua Lai, takes a molecule that scores well but can't be made and asks a language model for the shortest set of structural repairs that make it synthesizable: delete an atom, mutate one, add a bond, change a bond order, set a chiral centre. The model never writes a structure s

SWE-bench agents lose up to 14 points when a repo's surface changes

The Frontier

SWE-bench agents lose up to 14 points when a repo's surface changes

Two research papers landed back to back on what an agent score actually certifies — one strips a benchmark repo of everything familiar and watches the score fall, the other asks models to choose a direction before they can see where it leads. A Chinese studio closed the loop on the commercial side. Researchers at Shanghai Jiao Tong, Xi'an Jiaotong and East China Normal universities rewrote the SWE-bench repositories so that nothing about their behaviour changed, only their surface — and the cod

Stanford's kitchen robot demo has no paper, no code, and two tasks

The Frontier

Stanford's kitchen robot demo has no paper, no code, and two tasks

The weekend wire produced one genuinely new robot system, one number that decides the next two years of AI spending, and one executive saying out loud what every lab does quietly. Stanford and Caltech researchers have deleted the trained control layer between a language model and a humanoid, and the demo works — there is just no paper, no code and no numbers behind it. HomeBody puts GPT-6 Astra in charge of a Unitree G1: the model explores an unfamiliar kitchen, uses Astra as a Real2Sim agent t

A 243-cell 'periodic table' puts every AI at zero on control

The Frontier

A 243-cell 'periodic table' puts every AI at zero on control

The most useful thing to come out of a paper this week is a map, not a result. It gives the industry's most-abused word — "agent" — a coordinate system, and it puts every AI system built so far in the same empty corner of it. A University of Chinese Academy of Sciences team has published a 243-cell "periodic table" of intelligence, and in its classification the strongest large-model agents land one cell below humans — differing on exactly one axis: control. "Periodic Table of Agent Capabilities

Two frontier models max out Mensa Norway's IQ chart at 151

The Frontier

Two frontier models max out Mensa Norway's IQ chart at 151

Two models have run a public IQ test out of room this month. The more useful number is what they score when nobody has seen the questions. Anthropic's Fable 5.1 and OpenAI's GPT-6 Astra Ultra (Vision) both sit at 151 on the Mensa Norway leaderboard that TrackingAI publishes — the highest score the 35-question, 25-minute test can produce. TrackingAI is the weekly tracker run by US journalist Maxim Lott that puts roughly 30 models through the same paper every week and scores each one on the avera

NVIDIA's 100M-param diarizer tops the speaker-label leaderboard

The Frontier

NVIDIA's 100M-param diarizer tops the speaker-label leaderboard

NVIDIA quietly shipped the missing half of speech AI this week: not what was said, but who said it. Nemotron 3 Diarization is a 100-million-parameter open-weight model that labels up to eight speakers in live or recorded audio, and it arrives ranked first on VoiceArena's initial Diarization-Bench. Across 139 English conversations totalling roughly 22 hours, it scored a 14.72% diarization error rate against 19.3% for the next-best of the 12 systems evaluated — about a 24% relative gap — with ove

Claude solves a physicist's nine-loop challenge on an academic budget

The Frontier

Claude solves a physicist's nine-loop challenge on an academic budget

A public dare issued six weeks ago got beaten inside a month — and the winner spent less on compute than a conference trip. Two stories for you this afternoon. Claude computed a nine-loop scattering amplitude in N=4 super Yang-Mills — a frontier calculation that physicists had written off as too hard to attempt directly. The challenge came from Matt von Hippel, a former theoretical physicist turned science writer, who wrote in August that if AI companies wanted to impress people like him, they

Opus 5 cracks a second Enigma message — seven remain unsolved

The Frontier

Opus 5 cracks a second Enigma message — seven remain unsolved

Frontier models are quietly finishing the work Alan Turing never lived to see done — and the count of unsolved wartime ciphers is now low enough to fit on one hand. Claude Opus 5 has broken a second long-unsolved Enigma message — a German Army dispatch from 31 July 1941 that sat unread in the archive for 85 years — making it the second frontier-model cryptanalysis win validated in as many weeks. Cryptologist Frode Weierud published the write-up this week after Jack Willis contacted him on 21 Se

Skild's robot brain learned soccer by playing itself for 140 years

The Frontier

Skild's robot brain learned soccer by playing itself for 140 years

Skild AI says its S1 robotics model accumulated more than 140 years of simulated soccer inside NVIDIA's Isaac Sim, playing against recent copies of itself, and then transferred to a physical humanoid that played a real match. The published result, dated September 23, contains no success rate, no compute budget, no wall-clock training time and no comparison against a non-self-play baseline. What it does contain is a video of a robot in a blue-and-white jersey shielding a ball from a person, which