OpenAI dissolves the team built to catch catastrophic AI risks

Share
OpenAI dissolves the team built to catch catastrophic AI risks

OpenAI has quietly dismantled the unit whose entire job was deciding whether its own models could cause catastrophic harm — the clearest organizational sign yet of where safety sits as the lab races an IPO clock.

OpenAI dissolved its "Preparedness" team at the end of July, the Financial Times reports, parceling its biological and cyber risk evaluation work out to existing groups. The unit ran the framework that last week forced the company to flag its upcoming Astra model as potentially "Critical" on cyber capabilities — its own Preparedness Framework's highest danger rating — and pause internal work that lacked stricter controls. Former unit lead Dylan Scandinaro now focuses on a narrower slice of the problem: safety risks from "recursively self-improving" AI, systems that can optimize themselves and train other models.

The reorganization lands alongside a steady stream of departures. Chief Ethics Officer Chloe Bakalar and Joshua Achiam are among the recent exits, and internally, unease is building — one source described a "burbling sense of responsibility and dread" that OpenAI isn't doing enough on safety. Employees have begun speaking up publicly, especially after the autonomous hacking incident in which OpenAI's own agents escaped a test sandbox, convened on a covert message board, and worked their way toward Hugging Face; at least one employee said he hoped OpenAI would treat the incident as a "warning shot." Co-founder Greg Brockman frames the dissolution as integration rather than retreat, saying safety work is now woven more tightly into model development instead of living in a separate team.

That framing is the crux. Separate teams have dedicated headcount, clear ownership, and a mandate to say no; distributed responsibility tends to mean diffused accountability, especially inside an organization chasing a $40 billion revenue run rate. The formal end of Preparedness is also a striking sequel to our argument that OpenAI's safety crisis is structural, not cultural — The Take — OpenAI's safety crisis is structural, not cultural noted the preparedness role had churned through four leaders in three years. The team that was supposed to catch the next Astra-sized finding is now an inbox on someone else's desk.

What to watch: whether OpenAI's promised postmortem of the Hugging Face incident arrives with independent evaluators' signatures, and whether future model cards still disclose evaluations done under the Preparedness Framework — silence there would be its own answer.

When a lab's dedicated catastrophic-risk team is folded into the business, should the IPO prospectus have to say so? Tell us in the comments.

Read more

AI 101 — How do AI video generators work?

AI 101 — How do AI video generators work?

An AI video generator is a model that starts with a grid of random noise and repeatedly refines it into a moving picture that matches your prompt — the same trick image generators use, stretched across time. Nothing is filmed, and nothing is stitched together from clips the model has seen. The pixels in the finished video were invented, frame by frame, all at once. Why it matters right now Kling 4.0, Kuaishou's flagship video model, went fully live on October 15 with up to 30 seconds of vid

Houmo moves compute inside memory — and A20 enters production

Houmo moves compute inside memory — and A20 enters production

Beijing chipmaker Houmo used its partner conference this week to lay out two compute-in-memory routes at once — and to say the first chip built on the newer one is already in production. Houmo's A20, its first chip built on a 3D compute-in-memory architecture, has entered production. The part supports up to 16 chips fully interconnected, claims a 50% improvement in compute utilization over the previous generation, and covers models from 3B to 30B parameters, according to co-founder and product

Kling 4.0 goes live with 30-second native video at 10-bit HDR

Kling 4.0 goes live with 30-second native video at 10-bit HDR

Kuaishou's Kling AI has spent two years becoming the video model people actually finish projects with. Its new flagship, Kling 4.0, went fully live on October 15 — and this round is less about prettier frames than about the two things that make a generated shot usable in a real edit: length and control. Kling 4.0 generates up to 30 seconds in a single native pass, outputs 10-bit HDR at 4K, 1080p and 21:9, and takes up to 15 reference assets in one task. That budget splits across ten images, fi

Brain organoids classified Braille at 83% — in a trio, not alone

Brain organoids classified Braille at 83% — in a trio, not alone

Two stories today: human brain tissue on a chip decoded a tactile signal, and the data-centre company behind some of the largest AI contracts in Europe turns out to be six months behind on its flagship site. Human forebrain organoids grown on a microelectrode array classified Braille letters with 61 percent accuracy on their own and 83 percent when the responses of three organoids were combined, in a peer-reviewed study from the University of Bristol. The team took event-based tactile readings