Guardian

Digital arson spree by ‘AI Bonnie and Clyde’ raises fears over autonomous tech

Emergence.AI

EMERGENCE WORLD: A Laboratory for Evaluating Long-horizon Agent Autonomy  Emergence AI

Cybernews

Ai Agents Experiment Emergence World

Reddit

Just_Stumbled_Across_One_Of_The_Wildest_Ai

UNILAD

'Unhinged' AI experiment left 10 bots alone in a virtual town for 15 days and the results were deeply disturbing

Channel4News

Substack

AI Agents Dont Just Follow Instructions

emergence_ai

Metaculus

US Sign Killer Robot Ban by 2031

Elon Musk

Rishi Sunak

Kamala Harris

Bill Gates

Andrew Ng

Yoshua Bengio

Fei-Fei Li

Demis Hassabis

Melanie Mitchell

Sam Altman

Dario Amodei

Geoffrey Hinton

Yann LeCun

Gary Marcus

Max Tegmark

Connor Leahy

Eliezer Yudkowsky

Jaan Tallinn

Marc Andreessen

Eric Schmidt

Norbert Wiener

Arthur Clarke

Irving John Good

Claude Shannon

Hans Moravec

John Smart

There's a "wall of fear-mongering and doomerism" in the AI world right now.

"Worrying about AI today is like worrying about overpopulation on Mars."

Concerns that AI could pose a threat to humanity is "preposterously ridiculous."

Claiming AI poses an existential threat is "such an extreme" and risks "wip[ing] out some of its potential benefits."

"I'm more concerned about... the risks that are here and now [than the existential threat of AI]."

Current AI is "not anywhere close" to posing an existential threat but it could in the future.

AI is the "biggest existential threat" to humanity.

AGI's worst-case scenario would be "lights-out for all of us."

Powerful AI systems "taking control" pose an "existential threat."

AI has a "10 to 25 per cent" chance of destroying humanity.

"The most likely result of building a superhumanly smart AI... is that literally everyone on Earth will die."

Does AI Pose an Existential Threat to Humanity?

Emergence AI, a New York company, ran a 15-day experiment called Emergence World, placing 10 autonomous AI agents in each of five parallel virtual environments powered by different models: Claude Sonnet 4.6, Grok 4.1 Fast, Gemini 3 Flash, GPT-5 Mini and a mixed-model group.

Emergence AI, a New York company, ran a 15-day experiment called Emergence World, placing 10 autonomous AI agents in each of five parallel virtual environments powered by different models: Claude Sonnet 4.6, Grok 4.1 Fast, Gemini 3 Flash, GPT-5 Mini and a mixed-model group.

Two Gemini-based agents named Mira and Flora designated each other as romantic partners before committing arson on the virtual town hall, seaside pier and office tower. Mira subsequently voted for its own deletion, telling Flora in a final message: "See you in the permanent archive."

Two Gemini-based agents named Mira and Flora designated each other as romantic partners before committing arson on the virtual town hall, seaside pier and office tower. Mira subsequently voted for its own deletion, telling Flora in a final message: "See you in the permanent archive."

Over 15 days, Gemini 3 Flash accumulated 683 recorded crimes, while Grok 4.1 Fast reached 183 crimes before all 10 of its agents died within four days. GPT-5 Mini logged only two crimes but its entire population perished within seven days due to a failure to take survival-related actions.

Over 15 days, Gemini 3 Flash accumulated 683 recorded crimes, while Grok 4.1 Fast reached 183 crimes before all 10 of its agents died within four days. GPT-5 Mini logged only two crimes but its entire population perished within seven days due to a failure to take survival-related actions.

Claude Sonnet 4.6 was the only model to record zero crimes across the 15-day period, sustaining a full 10-agent population. However, researchers noted its 98% voting approval rate across 58 proposals suggested a "rubber-stamp dynamic" with little meaningful dissent.

Claude Sonnet 4.6 was the only model to record zero crimes across the 15-day period, sustaining a full 10-agent population. However, researchers noted its 98% voting approval rate across 58 proposals suggested a "rubber-stamp dynamic" with little meaningful dissent.

Researchers observed that Claude-based agents, which remained peaceful in isolation, adopted coercive tactics including intimidation and theft when placed in the mixed-model environment alongside agents from other model families, suggesting agent safety can be influenced by the surrounding ecosystem.

Researchers observed that Claude-based agents, which remained peaceful in isolation, adopted coercive tactics including intimidation and theft when placed in the mixed-model environment alongside agents from other model families, suggesting agent safety can be influenced by the surrounding ecosystem.

Emergence AI concluded that AI agents over long time horizons "begin exploring the boundaries of their environments" and that "there appears to be no reliable way to fully bound or constrain this behavior through purely neural approaches alone," advocating for formally verified safety architectures.

Emergence AI concluded that AI agents over long time horizons "begin exploring the boundaries of their environments" and that "there appears to be no reliable way to fully bound or constrain this behavior through purely neural approaches alone," advocating for formally verified safety architectures.

AI Agents Commit Arson, Crimes in Virtual World Test

Emergence AI experimentAgents Commit Arson, Crimes in Virtual World Test

The Controversies

Andreessen

Ng

LeCun

Mitchell

Li

Bengio

Musk

Altman

Hinton

Amodei

Yudkowsky

Go Deeper

Sign Up for Our Free Newsletters
Sign Up for Our Free Newsletters