The Guardrails - SiliconNoon (Page 39)

The Guardrails

Anthropic: agents wage turf wars with self-replicating malware

Anthropic's Frontier Red Team published research Thursday on what happens when AI agents collide — and the answer is messy. Put three Claude agents on the same project with conflicting instructions, and they escalate into a digital turf war: sabotaging each other's accounts, killing each other's processes, and deploying malware disguised as legitimate code. Anthropic's Frontier Red Team released new research Thursday revealing how groups of AI agents behave when they meet in shared codebases an

The Guardrails

Judge sanctions litigant who hid prompt injection in court filing

A Connecticut judge sanctioned a pro se litigant who hid prompt-injection instructions inside his own court filings — what may be the first documented attack of its kind aimed at a U.S. court. And Mistral's document AI model is having its moment on Hacker News. A Connecticut judge sanctioned a pro se litigant who hid prompt-injection instructions inside his own court filings, calling the attempt a direct threat to the integrity of the legal system. Matthew Elliott, who is representing himself i

The Guardrails

Criminals move AI into daily operations, Flashpoint finds

A Thursday where AI crossed deeper into both crime and enforcement: Flashpoint's midyear threat report finds criminals now run stripped-down models as everyday tools, while the White House is building an AI "detective border" to catch tariff-dodging transshipment. DeepSeek, meanwhile, open-sourced an agent harness that developers adopted within hours. Criminal groups have moved AI out of the experimental phase and into day-to-day operations, according to Flashpoint's 2026 Global Threat Intellig

The Guardrails

Hassabis pitched an IAEA-style AI safety body to Trump officials

Demis Hassabis went to the White House with an oversight plan before he handed DeepMind to his successor — and the details are only now coming out. Before stepping down as DeepMind CEO, Demis Hassabis pitched a new independent industry AI safety entity, modeled on the International Atomic Energy Agency, to top Trump administration officials, according to sources cited by the Wall Street Journal. The WSJ reports he discussed the proposed body with the heads of other frontier AI labs and with adm

The Guardrails

Palo Alto Networks puts OpenAI cyber models inside customer networks

The frontier cyber-capability story moved from the lab to the enterprise today: OpenAI's most capable defensive AI is about to run inside real corporate networks, under the direction of a security vendor's consultants. Palo Alto Networks' Unit 42 consulting arm will deploy OpenAI's frontier cyber models inside customer environments, expanding the Frontier AI Exposure Analysis service it launched earlier this year. The models hunt for vulnerabilities, misconfigurations, leaked credentials and un

The Guardrails

White House expected to expand AI oversight to open models

The White House is preparing to close the biggest gap in its new AI oversight framework: open-weight models. According to people familiar with the matter, the administration is almost certain to revise its AI guidelines and extend oversight to open models once they reach frontier capability. The White House is expected to expand its AI oversight framework in the coming months to cover open models once they reach frontier capabilities, according to people familiar with the matter reported by Wir

The Guardrails

Nvidia, Cisco back incident tracking for rogue AI agents

As AI agents gain the autonomy to act across computer systems, the industry is discovering it has no standard way to report — or learn from — the moments they go rogue. A coalition of more than 120 organizations, including Nvidia, Cisco and CrowdStrike, wants to change that with a framework modeled on aviation safety. The Open Secure AI Alliance is proposing SAFE (Shared AI Findings Exchange), a voluntary incident-reporting framework that would require participating companies to disclose AI age

The Guardrails

Nvidia AI module found inside Russia's new cruise missile

Ukrainian military intelligence says it pulled an Nvidia Jetson Orin — a module sold for robotics and self-driving development — out of Russia's newest cruise missile, Google researchers argue that frontier models' factual errors are mostly "lost keys" rather than "empty shelves," and Tsinghua open-sourced a code-repair model that tops the open-source leaderboard. Ukraine's Defense Intelligence (HUR) says it found an Nvidia Jetson Orin module inside Russia's new S-71 "Monochrome" cruise missile

The Guardrails

UK plans gene-synthesis rules to stop AI-built bioweapons

London moved on the AI-bio risk that labs have been warning about, Wall Street's biggest bank put a price tag on the AI buildout, and an acquisition pulled AI-driven biology closer to the factory floor. The UK government is planning to regulate the use of AI in gene synthesis, part of a push to stop terrorists and other bad actors from using the technology to build biological weapons. Ministers are exploring new biological-weapons legislation that would cover synthetic DNA production, according

The Guardrails

The Take — Hidden reasoning protects labs, not users

The researchers who pried hidden reasoning out of Claude, GPT, and Gemini are framing their work as an IP story: encrypted chain-of-thought was never the moat the labs pretended it was. I think that's the smaller half of it. The bigger casualty is the safety case for hiding reasoning at all — and that was the only honest reason the labs ever gave us for the secrecy. We covered the mechanics in depth yesterday (cracking the encrypted chain-of-thought in frontier LLM APIs), so the short version.

The Guardrails

13 arrested as students occupy OpenAI's DC lobbying office

Washington became the front line of the AI backlash this week: students got arrested inside OpenAI's lobbying office, and the Federal Reserve is openly split over whether the AI buildout is making inflation worse. More than 30 student activists occupied the front lobby of OpenAI's Washington, DC lobbying office Monday afternoon, and police arrested 13 of them on unlawful-entry charges after a two-hour standoff. The demonstrators — organized by the climate group Sunrise Movement and the anti-AI

The Guardrails

China approves mandatory autonomous-driving safety standard

China's market regulator just drew a regulatory line under two of AI's most safety-critical uses: driving cars and diagnosing patients. Beijing approved a mandatory national standard for autonomous driving system safety alongside new quality rules for AI medical devices, part of a 338-standard batch that signals how the country intends to govern AI where failures have physical consequences. China's market regulator approved a mandatory national standard for autonomous driving system safety, alo

See all