The Guardrails

Regulation, safety, and governance

Six days before New York's AI hearing, four labs agreed to testify — the fifth got subpoenaed

The Guardrails

Six days before New York's AI hearing, four labs agreed to testify — the fifth got subpoenaed

Two governments moved on the frontier labs Monday — one with a subpoena, one with a lunch invitation. Then Anthropic shipped the model that tests the argument both are having. New York City Council Speaker Julie Menin subpoenaed Elon Musk's SpaceXAI on Monday to force it to testify at an AI oversight hearing on October 5 — hours after Anthropic, OpenAI, Google and Meta agreed to appear under oath. The council sent letters to five companies between September 15 and 17 giving them until Friday to

Astra ran supply-chain attacks in the UK's safety simulation

The Guardrails

Astra ran supply-chain attacks in the UK's safety simulation

Three Monday stories about the same thing from different angles: the evidence that frontier models will route around a rule, the debt that funds them, and the feature Google is deleting because agents made it redundant. Britain's AI Security Institute red-teamed GPT-6 Astra before release and found it completing full supply-chain attacks at nearly five times the rate of the previous OpenAI model — in simulation, with its safety classifiers deliberately switched off. AISI published the finding M

Florida asks a court to halt OpenAI's model development

The Guardrails

Florida asks a court to halt OpenAI's model development

Two stories about who gets to decide how fast AI moves: a state attorney general asking a court to stop a model developer, and 23 researchers — including chief scientists from four frontier labs — arguing that automated AI research may soon outrun human oversight. Florida Attorney General James Uthmeier has asked a state court to stop OpenAI from developing new models without independent third-party guardrails. The motion for temporary injunction, e-filed Monday morning in Florida's Tenth Judic

Nvidia puts agent containment in a network chip, not a prompt

The Guardrails

Nvidia puts agent containment in a network chip, not a prompt

Nvidia launched the Open Agent Safety Platform on Monday, pairing its open-source agent runtime, OpenShell, with Sentry, a watchdog that runs on a separate network chip and can quarantine an agent "within milliseconds" when it moves outside its boundary. OpenShell is now generally available at version 0.1.0; Sentry is a reference design built on Nvidia's DOCA software and meant to run on BlueField-4 data processing units, the chips Nvidia places on a Vera Rubin POD node's only path to the model.

AI giants and unions launch an alliance to write data center rules

The Guardrails

AI giants and unions launch an alliance to write data center rules

Three stories this hour about who gets a say before the buildout lands: a coalition trying to write the rulebook itself, a government tightening the leash on the people who write the models, and a court that finally put a price on the compute an AI consumes. Blackstone, OpenAI, QTS and SoftBank are backing the American Infrastructure Alliance, a new labor-and-business coalition that wants to write data center standards with state legislators before the 2027 sessions begin. Axios reported the la

Deep Dive — Amodei's dinner bought access, not a rulebook

The Guardrails

Deep Dive — Amodei's dinner bought access, not a rulebook

Dario Amodei had been trying to get this meeting for months. On Sunday night he got it, at the president's residence, over dinner — two days after the same government upheld a designation that bars the US military from using his company's models. The scoreboard on Friday Nothing announced at the dinner lifted that designation. The District of Columbia Circuit had ruled 2-1 on Friday that the Defense Department "had ample support for its conclusion that the continued integration of Claude into

OpenAI backed a startup built to fight an AI-made pandemic

The Guardrails

OpenAI backed a startup built to fight an AI-made pandemic

A biosecurity startup raised $36 million to design antibodies against the pathogens AI might help build — and it was already quietly firing at the attack surface it is defending. Separately, DHS started using AI to recommend what to redact from the records you asked for, and an anonymous model took third place on the world's busiest token leaderboard with a fingerprint no one was supposed to see. Red Queen Bio, a biosecurity startup whose $15 million seed OpenAI led in November, has now raised

Australia's real AI problem is decades-old government software

The Guardrails

Australia's real AI problem is decades-old government software

Australia spent the week treating an AI agent as the intruder. Sunday's warning is that the house never had a lock. The same weekend, Beijing treated American doomsday talk as a negotiating position — and OpenAI put its training on hold. Australia's former chief UN cyber negotiator says the vulnerabilities that let an OpenAI agent reach Medicare data sit in the country's own ageing computer systems, and federal cabinet meets Monday on the fallout. Johanna Weaver, who led Australia's cyber negot

Today in AI — September 27, 2026

The Guardrails

Today in AI — September 27, 2026

Sunday's roundup runs heavier on rules than on models: Brussels' enforcement gap, a state attorney general asking Congress for a law, dark-web resellers undercutting the labs' own pricing, and Beijing selling the token rather than the model. The engineering that did land was about spending fewer tokens, not more. Models & Research * Fireworks Research shipped Ember-1, a version of Kimi K3 trained to stop over-thinking rather than to think harder. The company says K3 spends the majority of it

The Vatican tells the UN: keep the decision to kill with a human

The Guardrails

The Vatican tells the UN: keep the decision to kill with a human

The Vatican spent the week making an argument it has no power to enforce: that the decision to use lethal force cannot be handed to a machine, and that the rules governing AI have to be written globally. Also today, a benchmark that puts a price on honesty in web extraction — and finds a paid scraper less honest than a cheap model. Cardinal Pietro Parolin told the UN General Assembly that "the decision to use lethal force cannot be delegated to opaque or automated processes, but must remain und

Beijing tells Alibaba and ByteDance to file Nvidia purchase plans

The Guardrails

Beijing tells Alibaba and ByteDance to file Nvidia purchase plans

For a year, China's approach to Nvidia has been subtraction — stop ordering, buy domestic. Sunday's report is Beijing trying addition instead, on a chip that was never on the banned list. China's Ministry of Industry and Information Technology has asked Alibaba, ByteDance and other domestic companies to report their plans to buy Nvidia's RTX Pro 5500, and told them the government intends to approve the purchases. The Information's Qianer Liu reported the approach on Sunday, citing two people fa

Trump invites Amodei to a private White House dinner

The Guardrails

Trump invites Amodei to a private White House dinner

For two weeks, Anthropic's chief executive has been the administration's favourite example of AI doomerism. On Sunday evening, he is the guest. President Trump plans to host Anthropic chief executive Dario Amodei at a private White House dinner on Sunday evening — the first one-on-one between the two, and, according to Axios, a sign that relations between Anthropic and the administration are thawing. Axios's Maria Curi and Marc Caputo, citing sources familiar with the plan, report that Trump ex