Musk wants rivals to run test harnesses on each other's models

Share
Musk wants rivals to run test harnesses on each other's models

Two stories today run the same test on AI's gatekeepers: who gets to check the work before it ships, and what the answer looks like when the checker isn't the government. Then a biology dataset turned into a toy shows what happens when the public gets the keys.

Elon Musk wants the top labs — plus "three or four of the leading Chinese companies" — to let rivals run a "test harness" on their models before release. Speaking at the All-In Summit in Los Angeles on Monday, the SpaceX chief named his own company, OpenAI, Anthropic, Google and Meta as the labs that should open their models to competitors, framing it as a substitute for self-reporting: "instead of grading your own homework, you would at least have competitors grading your homework and raising the alarm if they see concerns." He put the government at the end of the line rather than the front — in his telling, officials should step in only if a lab flags a problem and then declines to fix it.

It is a different mechanism from the one Dario Amodei put on the table last week. Amodei's proposal embeds third-party evaluators with employee-like access inside a lab, while Musk's version gives competitors a week or two of access and lets the market of rivals do the auditing. We covered the industry's move toward that inside-access model when Amodei's essay landed and Altman matched the evaluator pledge within hours — Altman matches Amodei's evaluator pledge, Musk says 'Dario is right'.

The gap between the two plans is the honest part of the story. Musk acknowledged the rival labs haven't agreed to his proposal, and none of them has offered a timeline; labs do not currently hand unreleased frontier models to competitors. Handing your next model to a rival a fortnight before launch is a real business risk, which is exactly why the ask needed a name as loud as Musk's to get heard. He added that he thinks China would sign on to the scheme, which is the one claim in the pitch that no lab or government has confirmed.

In the same 24 hours, President Trump dismissed AI safety worries as a "hoax" and the White House's National Economic Council director Kevin Hassett said the private sector is the "right place" to solve them. So the argument has moved from whether to slow down to who holds the clipboard — and every proposed referee so far is either a competitor or the company itself.


A male fruit fly's connectome has escaped the lab and taken over the internet. Within days of the Janelia and Google map going public, developers dropped the wiring diagram into game engines: a Georgia Tech computer science graduate student, Evan Sinclair Smith, wired the simulated fly brain into Minecraft and posted the result on September 4 — millions of views inside a day — while another developer overfit its motor system to make it "play" Beat Saber, and others ran it through Doom. One modder, seeing the fly repeatedly fed into virtual danger, built a gentler project he calls Fruit Fly Heaven.

The caveat matters more than the videos. The connectome supplies wiring, not experience — developers still choose what sensory data enters the network and how firing turns into movement, and the Beat Saber run reproduces a recorded movement sequence rather than a decision. Smith has said the point is not a conscious fly. This is our second pass at whole-brain emulation in three weeks; the platform ambitions behind it were the story in August — China's DeepSoma simulates whole brains inside real physical worlds. What changed is that the public now has the raw material and the tools, and the results look like entertainment.


Profound raised $180 million at a $1.8 billion valuation to sell brands visibility inside AI answers. Sequoia and Kleiner Perkins led the Series D, seven months after a $96 million round, with Lightspeed, Khosla Ventures and South Park Commons returning. The company says revenue tripled in six months and it now counts more than 1,000 enterprise customers, including Comcast, Estée Lauder and Walmart; it has not disclosed the actual revenue figure, which makes the valuation a bet on a category rather than a number.

The product tracks how often ChatGPT, Perplexity, Gemini and Google's AI Overviews name a brand and in what context — the answer-engine equivalent of a rank tracker, for a search world that no longer shows a list of links. Profound is also pointing the same machinery at agents, monitoring the automated traffic reading customer websites, and it staffs "forward-deployed marketing engineers" alongside its own agents. The uncomfortable dependency is baked in: the whole business assumes models keep mentioning brands in ways that can be measured and nudged, and Profound has no vote in how they do that.

What to watch: whether any lab actually agrees to open an unreleased model to a rival on Musk's terms — the first yes is the story, not the proposal.

Should competitors, not regulators, be the ones who see your model first? Tell us in the comments.

Read more

Akhetonics says its all-optical CPU reaches a customer in 2026

Akhetonics says its all-optical CPU reaches a customer in 2026

Light-based computing keeps promising more than it delivers — but one Munich startup has just put a date on its bet, and the interview laying it out is doing the rounds on Hacker News this week. Akhetonics says it will deploy its first commercial machine with a major customer by the end of 2026, with several more planned for 2027. The company, founded by Michael Kissner and Leonardo Del Bino, is building a computer where data enters as light, is switched as light, and circulates through memory

The Week in AI — October 5–11, 2026

The Week in AI — October 5–11, 2026

Every big claim this week turned out to rest on fine print more interesting than the headline: revenue only the company reporting it can define, safety tests sandboxed while the product keeps the web, and a Pentagon phase-out nobody would confirm until reporters kept asking. The week's top 5 1. OpenAI's revenue was $20 billion below the numbers everyone quoted — and the gap was definitional. The Financial Times reported Thursday that OpenAI's annualized revenue runs roughly $20 billion unde

Drone strike shuts a third Yandex data center, taking YandexGPT offline

Drone strike shuts a third Yandex data center, taking YandexGPT offline

Russia's largest tech company is learning what the AI era's infrastructure war looks like from the receiving end — three data centers in four days, and with them much of the cloud layer Russian businesses run on. A Ukrainian drone strike knocked out Yandex's data center in Vladimir early Sunday morning, the third of the company's facilities hit since October 8. The site — reported at roughly 50 MW and designed for about 2,880 server racks — stopped operating completely after the attack, Yandex

Agent teams cost up to 5x more, barely score higher

Agent teams cost up to 5x more, barely score higher

The multi-agent hype train hit a benchmark this weekend — and the grid and the trucking regulators had quiet weeks of their own. Vals AI put agent teams head-to-head with single agents on its Vibe Code Bench, and the teams cost between 1.8 and 5.1 times more for almost no extra quality. The evals company ran GPT-6 Sol and Claude Opus 5.5 solo and in teams across 50 apps at two reasoning efforts; out of four comparisons, only one was statistically significant — Sol at medium effort, where the t