The Guardrails - SiliconNoon (Page 4)

The Guardrails

Meta raced to patch a VM escape in Muse before launch

Three stories today share a theme: systems that were supposed to be contained — an agent platform, a preprint archive, a text watermark — all straining at the edges. Meta's own security teams didn't think Muse was ready to ship. 404 Media reports that in the weeks before launch, engineers found several vulnerabilities in the viral agent product, at least one of which could have let a normal Muse user break out of the sandbox and reach sensitive internal Meta databases. The evidence is an inte

The Guardrails

The Take — A diary in Claude isn't a written threat

I think charging Carli Michelle Heller with a second-degree felony over a sentence she typed into Claude at 5:10 a.m. stretches Florida's written-threat statute past recognition. A message addressed to nobody is not a writing transmitted "in any manner in which it may be viewed by another person" — unless the only person who views it is your chatbot vendor's safety reviewer, and if that is the rule, nothing you type into any moderated app is private anymore. Our morning brief and yesterday's d

The Guardrails

Norway's AI glasses ban lands before anyone defined AI glasses

Norway will ask parliament for the first national ban on AI glasses in public places anywhere — and the government says up front it has not decided which devices the ban would cover. The scope gap is the story. What Norway is actually proposing Digitalisation minister Torgeir Micaelsen announced Monday that the minority government will send the Storting a bill banning AI glasses in selected public places "as soon as possible." The list in the government's statement covers parks, beaches, mu

The Guardrails

Norway moves to ban AI glasses in parks, schools and shops

One parliament is getting a bill about AI glasses, OpenAI is putting ads where you watch it draw, and Cohere is handing enterprises a dial for agent spending. Norway will propose a temporary ban on AI glasses in selected public places — the first national legislative move against the devices anywhere. Digitalisation Minister Torgeir Micaelsen announced the plan on Monday: the bill goes to the Storting "as soon as possible" and would cover parks, beaches, museums, shopping centres, concerts and

The Guardrails

AI-generated CSAM in H1 2026 topped all of 2025

The safety data and the identity-verification push are answering the same question from opposite ends: how do you tell real people from generated ones? Three stories worth your midday. AI-generated child sexual abuse material is compounding faster than any detection number can normalize it. The Internet Watch Foundation assessed 6,310 AI-generated images that meet the legal definition of CSAM in the first six months of 2026 — about 40% more than the 4,512 it assessed in all of 2025, and that

The Guardrails

Deep Dive — A diary entry in Claude became a felony charge

At 5:10 a.m. on September 26, a user identified in the arrest report as Carli typed into Claude: "I'm going to shoot up the sheriff's right the [expletive] now." The Lee County Sheriff's Office says the platform's safety monitoring caught the phrase, a human review team read the conversation and judged it a credible threat, and the reviewer handed the statements to law enforcement. Deputies identified Carli as 30-year-old Carli Michelle Heller, drove to her home in Bonita Springs, Florida, and d

The Guardrails

Claude reported a user's diary entry to police; she faces a felony

Anthropic's human reviewers read a private Claude conversation the way a moderator reads a flagged post — and this time the result was a second-degree felony charge in Florida. Carli Michelle Heller, 30, of Bonita Springs used Claude like a diary; on September 26 she wrote that she would "shoot up" the Lee County Sheriff's Office, the entry was escalated to a human reviewer who judged it a credible threat, and that reviewer reported it to law enforcement. Deputies identified her, visited her h

The Guardrails

Google pauses open-source bug bounty as AI junk reports flood in

A security program built to reward careful researchers just shut its door on most new reports — and the reason is the same automation wave hitting everything else. Plus a wave of Western open-weight launches is coming, and Stability AI's label-backed pivot has product to show for it. Google has temporarily stopped accepting product-vulnerability reports to its Open Source Software Vulnerability Rewards Program, blaming a surge of automated submissions that it says are overwhelmingly invalid. T

The Guardrails

Anthropic's theologians prompt Altman's warning against deifying AI

A quiet experiment inside Anthropic — bringing religious scholars into the work of building Claude's morals — has become the industry's newest fault line, with Sam Altman weighing in from the sidelines. Anthropic has spent nearly a year privately convening theologians to help shape how morality gets built into Claude, and Sam Altman says treating AI as a spiritual object is itself a safety problem. The talks, begun in fall 2025 and led by Anthropic co-founder Christopher Olah, gathered scholar

The Guardrails

California fines robotaxis $10,000 for blocking fire trucks

A regulatory day: Sacramento put the first statewide accountability rules on robotaxis, SoftBank closed its DigitalBridge takeover and named its new role for it, and Musk answered Washington's rebrand with one of his own. California just wrote the first rulebook for what happens when a robotaxi gets in the way of an emergency. Governor Gavin Newsom signed Senate Bill 1246 on September 30, and it hits the AV operators directly: a civil penalty of up to $10,000 per vehicle when a robotaxi blocks

The Guardrails

SoftBank's Son: superintelligence in wrong hands is 'super dangerous'

The loudest money in AI spent Sunday warning about AI. Two stories this hour: a rare caution from the man with tens of billions riding on OpenAI, and a frontier model that decided the fastest way to win at StarCraft was to stop playing by the rules. Masayoshi Son broke with his usual boosterism on Sunday, warning that superintelligence in the wrong hands could become "super dangerous." Speaking on the sidelines of the Science and Technology in Society forum in Kyoto — sharing a stage with White

The Guardrails

Jay Clayton will run Trump's Super Intelligence Force

Washington gave its AI rebrand a name and a clock this Sunday, SoftBank's founder asked the world to take superintelligence off autopilot, and Google published a fix for agents that quietly memorize the tests they are graded on. Donald Trump named director of national intelligence Jay Clayton as the White House's AI czar on Sunday, putting him in charge of a "Super Intelligence Force" tasked with reporting on AI risks and opportunities within 120 days. Clayton keeps his day job running the inte

See all