UN chief warns the AI race could end in a 'gigantic disaster'
A day after Washington dismissed AI fears as a hoax, the United Nations put them at the top of the world's agenda.
António Guterres warned Wednesday that AI development is outrunning human understanding of its risks, and told the countries at the frontier they should build "mechanisms of contact, of exchange of information and some common guardrails" — or accept a race to the bottom that "could lead one day to a gigantic disaster at the global level." Speaking to reporters ahead of next week's General Assembly in New York, the UN Secretary-General said stronger oversight would be a major focus of his meetings with arriving leaders, and grounded the duty in the basics of statecraft: "It's the first responsibility of any government to protect its citizens — including from the threats of artificial intelligence." He was careful to protect AI's upside, citing "enormous potential" for health, education, climate resilience and the pace of sustainable development, and pointed to the UN's Independent International Scientific Panel on AI as the evidence base the debate should run on.
The timing is the story. Guterres does not usually pick fights with a sitting US president from a press podium, and he did this one two days after Donald Trump called the alarm a "HOAX" and a "conspiracy," writing that "the only control or 'guardrails' that AI needs is a STRONG AND SMART (High IQ!) PRESIDENT." Diplomats say the Security Council may also convene on AI during summit week — only the second time the 15-member body has taken up the topic since its first AI session in 2023. And Guterres's words land a week before Trump meets Xi Jinping in Washington, with the two governments having already scheduled lower-level talks on AI risk. A UN chief asking frontier states to establish contact mechanisms is an attempt to shape that bilateral agenda before the two rivals set it alone.
That is also the weakness. Everything the UN has built on AI so far is advisory: the 39-member high-level body it created in 2023, and the scientific panel now producing the assessments Guterres wants leaders to argue from. Neither can compel a lab or a state, and the "mechanisms of contact" he describes — information exchange, shared guardrails — are deliberately the least binding instruments available, which is precisely why they might survive contact with Washington and Beijing. It is the same question the EU opened this week when Ursula von der Leyen called AI the second tipping point of our times, the same one Sam Altman answered with a plea for the world to trust the labs anyway, and the same one the industry's own pacing push has been circling for two weeks. The diplomatic channel we have been tracking — the first dedicated US-China AI safety talks scheduled ahead of the summit — is where a Guterres proposal either becomes an agenda item or stays a speech.
What to watch: whether the Security Council actually convenes on AI next week, whether the Trump–Xi meeting produces any AI deliverable at all, and whether the phrase "mechanisms of contact" shows up in joint language from either. A UN Secretary-General with no enforcement power is testing whether naming the race to the bottom is enough to slow it.
Should the guardrails be negotiated by the two frontier powers, or by the institution that claims to speak for everyone else? Tell us in the comments.
