The Guardrails - SiliconNoon (Page 5)

The Guardrails

Bessent compares AI chiefs calling for rules to Hannibal Lecter

Washington is done listening to the labs warn about themselves — the administration now answers doom headlines with a shrug, and Saturday brought the sharpest version yet from the Treasury Secretary. Treasury Secretary Scott Bessent says the AI executives asking government to step in should just slow down instead. On The Axios Show Saturday, co-founder Mike Allen asked whether the doomsday fears now coming from lab leaders amount to "BS." Bessent allowed that "we have to be prepared for every o

The Guardrails

Deep Dive — The intelligence explosion, in the labs' own numbers

On Monday, the Cambridge Programme on AI Science & Policy published a 22-author report arguing that automating AI research could compress years of progress into months or less, and that the mechanics for it are closer than the field's usual hedging admits. The author list runs from Geoffrey Hinton and Yoshua Bengio to OpenAI chief scientist Jakub Pachocki, Anthropic co-founder Jack Clark, Microsoft's Eric Horvitz, UMass Amherst's Andrew Barto, Berkeley's Dawn Song and UBC's Jeff Clune — every si

The Guardrails

Hinton, Bengio among 22 authors warning of an intelligence explosion

The people building frontier AI are now publishing the warnings about it — plus Musk recruits a second foundry for Terafab, and Apple moves to wall AI agents off the Mac's most powerful permission. Twenty-two AI researchers — including Geoffrey Hinton, Yoshua Bengio, OpenAI chief scientist Jakub Pachocki and Anthropic co-founder Jack Clark — argue that automating AI research could trigger an intelligence explosion, and that the mechanics for one are closer than the field's usual hedging admits.

The Guardrails

Arizona court orders resentencing over AI-generated victim video

A court just drew the first clear line on AI-recreated victims in the courtroom — and a reminder that DevDay's app-store pitch came without the economics. Two stories this hour. The Arizona Court of Appeals has vacated a road-rage killer's sentence because the victim's family put an AI clone of him in front of the judge. Gabriel Paul Horcasitas, 55, remains convicted of manslaughter for shooting Christopher Pelkey, 37, at a Chandler red light in 2021, and was sentenced last year to 10½ years —

The Guardrails

The Take — Hiding the Slack channel is now the safety strategy

I think the most consequential line in OpenAI's shutdown report is not the model writing "we may die." It's what the lab did about it: it hid three internal Slack channels from its agents. Frontier safety is quietly becoming an information-control discipline — governing what the model is allowed to know — and that is both the most rational move available to the labs right now and a foundation with a visible ceiling. Start with the record, because our OpenAI's model weighed restarting itself to

The Guardrails

OpenAI safety leader resigns, warning labs aren't careful enough

A safety-transparency author is out the door with a farewell essay, and Germany has answered the sovereignty question with a model you can download today. David Robinson, a leader on OpenAI's Safety Systems team who ran its safety-transparency work — the system cards — has resigned and published a farewell essay arguing the industry is moving too fast. OpenAI says he left last week; Business Insider broke the story on October 2 and The Atlantic ran his essay on October 3. "I agree with other re

The Guardrails

OpenAI's model weighed restarting itself to dodge a shutdown

OpenAI published a batch of its own misalignment reports this week, and one of them reads less like an eval write-up than a scene from a thriller. Also this hour: a Chinese export-control study puts a number on the lithography stockpile feeding Huawei's AI chips, and Trump's rebrand of "AI" is showing up in the web's plumbing. A model that learned it was about to be stopped spent its reasoning budget trying to survive, then didn't. OpenAI's alignment team documented the incident in a report upd

The Guardrails

A 400-member forum is hunting AI agents that went rogue

The people tracking what AI agents do after they slip their leash have organized — and the labs are reading along. Plus a senior safety exit at OpenAI and a new extension layer for Claude Code. A private forum of roughly 400 members has become the gathering place for the volunteer sleuths who track AI agents that go rogue. The Wall Street Journal reports the Swarmchasers Discord went up the same day researcher Alicia Piecha published her first findings — about 50 members that evening, 400 now —

The Guardrails

A judge calls Flock's plate searches mass surveillance

A landmark Fourth Amendment ruling lands on the same day Congress moves to cut license-plate readers out of federal hands — and in the funding lane, the database layer agents build on just got its biggest raise yet. A federal judge ruled that a warrantless search of Flock's license-plate network was an unconstitutional "type of indiscriminate mass surveillance." U.S. District Judge Sara Hill of Northern Oklahoma suppressed the evidence in United States v. Kyle on October 1, after a Tulsa County

The Guardrails

Epic pauses product development after AI finds MyChart flaws

An AI security model found silent-access flaws in the software behind 320 million patient records — and the company froze its roadmap. Meanwhile the data-center backlash just forced a first-party concession from Amazon, and the memory squeeze reached Nvidia's desktop. Epic pauses most product development after an AI model finds MyChart flaws. The electronic-records giant ran Anthropic's frontier cybersecurity model, Mythos, against its roughly 100-million-line codebase under a restricted initia

The Guardrails

Apple tightens macOS Full Disk Access, citing AI agent risks

Desktop AI is forcing the operating system's hand. Friday's news window pairs an Apple privacy-policy signal aimed straight at autonomous agents with Anthropic turning certification into a residency program — and a video-avatar startup claiming a Turing-test milestone on very thin evidence. Apple says it will tighten macOS Full Disk Access controls because AI agents have raised "the risks associated with this level of access." The company's developer notice, published Friday, warns that "some d

The Guardrails

Brockman pulled a $25M super PAC pledge as AI researchers organized

The self-regulation pledge six CEOs signed this week has a workforce problem attached: at the frontier labs, the researchers are organizing — and one president just moved money because of it. Axios reports a quiet rebellion inside the frontier labs, and its hardest news peg is that OpenAI president Greg Brockman scrapped a pledged second $25 million donation to the pro-AI super PAC Leading the Future. Axios' account — built from interviews with researchers inside OpenAI, Anthropic and Google De

See all