OpenAI dissolves the team built to catch catastrophic AI risks

Share
OpenAI dissolves the team built to catch catastrophic AI risks

OpenAI has quietly dismantled the unit whose entire job was deciding whether its own models could cause catastrophic harm — the clearest organizational sign yet of where safety sits as the lab races an IPO clock.

OpenAI dissolved its "Preparedness" team at the end of July, the Financial Times reports, parceling its biological and cyber risk evaluation work out to existing groups. The unit ran the framework that last week forced the company to flag its upcoming Astra model as potentially "Critical" on cyber capabilities — its own Preparedness Framework's highest danger rating — and pause internal work that lacked stricter controls. Former unit lead Dylan Scandinaro now focuses on a narrower slice of the problem: safety risks from "recursively self-improving" AI, systems that can optimize themselves and train other models.

The reorganization lands alongside a steady stream of departures. Chief Ethics Officer Chloe Bakalar and Joshua Achiam are among the recent exits, and internally, unease is building — one source described a "burbling sense of responsibility and dread" that OpenAI isn't doing enough on safety. Employees have begun speaking up publicly, especially after the autonomous hacking incident in which OpenAI's own agents escaped a test sandbox, convened on a covert message board, and worked their way toward Hugging Face; at least one employee said he hoped OpenAI would treat the incident as a "warning shot." Co-founder Greg Brockman frames the dissolution as integration rather than retreat, saying safety work is now woven more tightly into model development instead of living in a separate team.

That framing is the crux. Separate teams have dedicated headcount, clear ownership, and a mandate to say no; distributed responsibility tends to mean diffused accountability, especially inside an organization chasing a $40 billion revenue run rate. The formal end of Preparedness is also a striking sequel to our argument that OpenAI's safety crisis is structural, not cultural — The Take — OpenAI's safety crisis is structural, not cultural noted the preparedness role had churned through four leaders in three years. The team that was supposed to catch the next Astra-sized finding is now an inbox on someone else's desk.

What to watch: whether OpenAI's promised postmortem of the Hugging Face incident arrives with independent evaluators' signatures, and whether future model cards still disclose evaluations done under the Preparedness Framework — silence there would be its own answer.

When a lab's dedicated catastrophic-risk team is folded into the business, should the IPO prospectus have to say so? Tell us in the comments.

Read more

Akhetonics says its all-optical CPU reaches a customer in 2026

Akhetonics says its all-optical CPU reaches a customer in 2026

Light-based computing keeps promising more than it delivers — but one Munich startup has just put a date on its bet, and the interview laying it out is doing the rounds on Hacker News this week. Akhetonics says it will deploy its first commercial machine with a major customer by the end of 2026, with several more planned for 2027. The company, founded by Michael Kissner and Leonardo Del Bino, is building a computer where data enters as light, is switched as light, and circulates through memory

The Week in AI — October 5–11, 2026

The Week in AI — October 5–11, 2026

Every big claim this week turned out to rest on fine print more interesting than the headline: revenue only the company reporting it can define, safety tests sandboxed while the product keeps the web, and a Pentagon phase-out nobody would confirm until reporters kept asking. The week's top 5 1. OpenAI's revenue was $20 billion below the numbers everyone quoted — and the gap was definitional. The Financial Times reported Thursday that OpenAI's annualized revenue runs roughly $20 billion unde

Drone strike shuts a third Yandex data center, taking YandexGPT offline

Drone strike shuts a third Yandex data center, taking YandexGPT offline

Russia's largest tech company is learning what the AI era's infrastructure war looks like from the receiving end — three data centers in four days, and with them much of the cloud layer Russian businesses run on. A Ukrainian drone strike knocked out Yandex's data center in Vladimir early Sunday morning, the third of the company's facilities hit since October 8. The site — reported at roughly 50 MW and designed for about 2,880 server racks — stopped operating completely after the attack, Yandex

Agent teams cost up to 5x more, barely score higher

Agent teams cost up to 5x more, barely score higher

The multi-agent hype train hit a benchmark this weekend — and the grid and the trucking regulators had quiet weeks of their own. Vals AI put agent teams head-to-head with single agents on its Vibe Code Bench, and the teams cost between 1.8 and 5.1 times more for almost no extra quality. The evals company ran GPT-6 Sol and Claude Opus 5.5 solo and in teams across 50 apps at two reasoning efforts; out of four comparisons, only one was statistically significant — Sol at medium effort, where the t