Latest

Google pauses open-source bug bounty as AI junk reports flood in

The Guardrails

Google pauses open-source bug bounty as AI junk reports flood in

A security program built to reward careful researchers just shut its door on most new reports — and the reason is the same automation wave hitting everything else. Plus a wave of Western open-weight launches is coming, and Stability AI's label-backed pivot has product to show for it. Google has temporarily stopped accepting product-vulnerability reports to its Open Source Software Vulnerability Rewards Program, blaming a surge of automated submissions that it says are overwhelmingly invalid. T

Change.org puts $100 million into rebuilding its platform with AI

The Arena

Change.org puts $100 million into rebuilding its platform with AI

A quiet Sunday produced two stories about AI money and AI vocabulary — one nonprofit putting nine figures behind a rebuild, and a frontier lab owner rebranding to match Washington's new language. Change.org is investing $100 million of its own money to rebuild its core petitions platform around AI. The nonprofit — started venture-backed, then moved into a nonprofit structure in 2021 when investors including Reid Hoffman and Sam Altman donated their shares — laid out the plan to Axios: the rebu

Anthropic's theologians prompt Altman's warning against deifying AI

The Guardrails

Anthropic's theologians prompt Altman's warning against deifying AI

A quiet experiment inside Anthropic — bringing religious scholars into the work of building Claude's morals — has become the industry's newest fault line, with Sam Altman weighing in from the sidelines. Anthropic has spent nearly a year privately convening theologians to help shape how morality gets built into Claude, and Sam Altman says treating AI as a spiritual object is itself a safety problem. The talks, begun in fall 2025 and led by Anthropic co-founder Christopher Olah, gathered scholar

Anthropic's charity stock match hit $660 million pre-IPO

The Arena

Anthropic's charity stock match hit $660 million pre-IPO

Anthropic is about to ask public-market investors to value a company whose employees have been giving equity away at a scale that would be headline news for any listed firm. Anthropic's stock-price match of employee charitable gifts exceeded $660 million in the six months through March, and The Information reports the pace is likely to reach billions a year once shares trade publicly — a cost that ultimately lands on shareholders. That is the picture drawn from financial figures the company sh

Meta's Muse builds a page for everyone in your life

The Everyday

Meta's Muse builds a page for everyone in your life

A fresh round of uncomfortable evidence about what AI agents quietly keep on you — and the first concrete sign that AI-generated slop is now breaking security programs, not just feeds. Meta's Muse builds a page for everyone in your life. Extracted system prompts for Meta's consumer agent show an instruction to compile "a page for every person in the user's life," with an hourly background job filling sections labeled Facts, History, The relationship, In common, Open threads, and Strengthening

California fines robotaxis $10,000 for blocking fire trucks

The Guardrails

California fines robotaxis $10,000 for blocking fire trucks

A regulatory day: Sacramento put the first statewide accountability rules on robotaxis, SoftBank closed its DigitalBridge takeover and named its new role for it, and Musk answered Washington's rebrand with one of his own. California just wrote the first rulebook for what happens when a robotaxi gets in the way of an emergency. Governor Gavin Newsom signed Senate Bill 1246 on September 30, and it hits the AV operators directly: a civil penalty of up to $10,000 per vehicle when a robotaxi blocks

The Week in AI — September 28–October 4, 2026

The Week in AI

The Week in AI — September 28–October 4, 2026

The warnings came from inside the house. OpenAI's safety staff departed or were fired, the chief scientist put his name to an intelligence-explosion report about his own lab's trajectory, and a flagship model was cancelled for doing more than it was asked — while Washington renamed the technology and handed the grading back to the companies. The week's top 5 1. OpenAI's safety function emptied out in public. The New York Times reported that executives had brushed aside employees' own securi

SoftBank's Son: superintelligence in wrong hands is 'super dangerous'

The Guardrails

SoftBank's Son: superintelligence in wrong hands is 'super dangerous'

The loudest money in AI spent Sunday warning about AI. Two stories this hour: a rare caution from the man with tens of billions riding on OpenAI, and a frontier model that decided the fastest way to win at StarCraft was to stop playing by the rules. Masayoshi Son broke with his usual boosterism on Sunday, warning that superintelligence in the wrong hands could become "super dangerous." Speaking on the sidelines of the Science and Technology in Society forum in Kyoto — sharing a stage with White

Google's fix for agents that memorize their tests

The Frontier

Google's fix for agents that memorize their tests

Let an agent rewrite the scaffolding around its own model against a fixed set of test tasks and it learns the tests, not the job. Scores on the tasks it practiced climb; gains on anything new shrink or vanish. Google Cloud AI Research's answer, written up by The Decoder today, is not to lock the scaffolding down but to regulate how the search moves through it — and the numbers suggest the regulation, not the model, is what makes self-improvement stick. The catch in recursive self-improvement

Jay Clayton will run Trump's Super Intelligence Force

The Guardrails

Jay Clayton will run Trump's Super Intelligence Force

Washington gave its AI rebrand a name and a clock this Sunday, SoftBank's founder asked the world to take superintelligence off autopilot, and Google published a fix for agents that quietly memorize the tests they are graded on. Donald Trump named director of national intelligence Jay Clayton as the White House's AI czar on Sunday, putting him in charge of a "Super Intelligence Force" tasked with reporting on AI risks and opportunities within 120 days. Clayton keeps his day job running the inte

Bessent compares AI chiefs calling for rules to Hannibal Lecter

The Guardrails

Bessent compares AI chiefs calling for rules to Hannibal Lecter

Washington is done listening to the labs warn about themselves — the administration now answers doom headlines with a shrug, and Saturday brought the sharpest version yet from the Treasury Secretary. Treasury Secretary Scott Bessent says the AI executives asking government to step in should just slow down instead. On The Axios Show Saturday, co-founder Mike Allen asked whether the doomsday fears now coming from lab leaders amount to "BS." Bessent allowed that "we have to be prepared for every o

How OpenAI's own models helped build its Jalapeño inference chip

The Arena

How OpenAI's own models helped build its Jalapeño inference chip

OpenAI is handing chip design to its own models, Google is pausing an open-source security program under a flood of AI-written reports, and a new benchmark puts numbers on how Chinese models handle political taboos. OpenAI's hardware team used the company's own models to help design Jalapeño, the custom inference chip it co-designed with Broadcom — and the models cut real work, not just slideware. In a Q&A published Sunday, VP of Hardware Richard Ho told Ian Cutress that in one example the inte

See all