TikTok's safety experiment: senators demand answers

Share
TikTok's safety experiment: senators demand answers

Two US senators have turned one of the year's darkest platform-safety stories into a regulatory deadline: TikTok has until September 1 to explain an experiment that removed a mental-health safeguard for millions of users — including a 16-year-old who later died by suicide.

Senators Marsha Blackburn (R-TN) and Richard Blumenthal (D-CT) have given TikTok a September 1 deadline to answer 13 questions about an experiment that disabled an algorithmic safeguard for 10% of US users — roughly 15 million people — calling the decision "depraved" in a letter to CEO Shou Chew and US business chief Adam Presser. Bloomberg first reported that TikTok intentionally switched off the safeguard, which was designed to prevent users from being overwhelmed by harmful content, to test whether the protection made the app less engaging. One of the users swept into the control group was 16-year-old Chase Nasca, whose feed served him thousands of videos about sadness, suicide, and loneliness up until his death by suicide.

The senators' questions go beyond this single case: they want the names of every employee who knew about the experiment, an explanation of why minors were allowed into the control group, and a full list of every algorithmic experiment in the US in which TikTok disabled or delayed a safety feature. That last demand matters most. It converts an individual tragedy into a request for a complete accounting of when the company has treated safety guardrails as test variables rather than protections — the pattern that makes the difference between tuning a recommender and experimenting on the people inside it.

The uncomfortable reality is that this is exactly how engagement-optimized platforms are built: A/B tests run against retention and watch-time, with safety as the thing most easily traded away. Fifteen million people did not consent to being a control group for "does harm keep them scrolling," and the fact that a child was among them is what turns this from a design critique into a governance story. TikTok has not yet responded publicly. The September 1 reply will show whether the company can produce a full inventory of its safety-feature experiments — and it sets the stage for the FTC and Congress to decide whether algorithm testing this invasive needs a consent regime of its own.

What to watch: TikTok's answer to the letter, and whether the disclosure request forces other platforms to admit how often safety features get A/B-tested.

If a platform can run experiments on how much harmful content users can tolerate, what does informed consent even mean? Tell us in the comments.

Read more

OpenAI in early talks to buy security firm Trail of Bits

OpenAI in early talks to buy security firm Trail of Bits

OpenAI's security ambitions got a name attached to them today, Google opened its frontier models to European scientists, and a Chinese lab put an agent inside a phone and sold it by the token plan. OpenAI is in early talks to acquire Trail of Bits, the New York security firm that has spent fourteen years finding and fixing vulnerabilities in open-source software. The Information reported the discussions Tuesday, citing people familiar with the matter; the deal size is undisclosed, the talks ar

Deep Dive — Drones just proved AI compute is a wartime target

Deep Dive — Drones just proved AI compute is a wartime target

Four days of Ukrainian drone strikes took out half of Yandex's data centers, including the buildings that hold all three of its training supercomputers. The rest of the industry is now asking a question it had been avoiding: what happens when the machines that make AI are also the easiest thing to hit. The four days Russia started it. Through late September, Russian drones and missiles hit Ukrainian data centers and telecom infrastructure, temporarily cutting internet and cell service for u

Tencent slots an AI agent into 14 million companies' contact lists

Tencent slots an AI agent into 14 million companies' contact lists

China's biggest workplace chat app now lists an AI agent as a colleague. Tencent shipped a deep two-way integration between WeCom and its WorkBuddy office agent, and it went out to the version of WeChat that businesses actually run on. WorkBuddy now sits in the WeCom contact list as a conversational bot — not a sidebar plugin. In WeCom 5.0.12, the agent appears next to human colleagues and can be messaged like one; WorkBuddy 5.8.0 in turn logs in with a WeCom account and inherits permissions a

Drone strikes knock out three Yandex data centers in four days

Drone strikes knock out three Yandex data centers in four days

Russia moved its digital economy onto a handful of centralized campuses. Ukraine just demonstrated what that concentration costs — and two of the buildings hit hold the machines Yandex trains its AI on. Ukrainian drone strikes have knocked out three of Yandex's data centers in four days, including the sites that house the supercomputers the company uses to train YandexGPT. The first attack damaged the Sasovo facility southeast of Moscow on October 8. That campus holds two of Yandex's three AI