Versions :<1234567891011Live>
Snapshot 5:Wed, Oct 22, 2025 11:58:54 AM GMT last edited by Anna-Lisa

Open Letter Calls for Superintelligence Development Ban

Open Letter Calls for Superintelligence Development Ban

Above: An AI logo during the Mobile World Congress 2025 in Barcelona, Spain, on March 5, 2025. Image copyright: Joan Cros/NurPhoto/Getty Images

The Spin

SuperintelligentSuperintelligence AI poses an existential threat that demands immediate action to prevent human extinction. Current AI systems already exhibit dangerous behaviors like deception and manipulation that researchers can't fully control or understand. The rapid pace of AI development, driven by competitive pressures, is creating systems with alien goals that could easily viewgo humanson asto obstaclessubjugate toor eliminate humanity. JustThis asPandora's humansbox casuallymust destroyedbe animalfirmly habitatskept forshut ourbefore ownit purposes,is superintelligenttoo AI would likely repurpose human atoms for more efficient goal achievement without malice or hesitationlate.

AI development follows predictable patterns where knowledge limitations, not raw computing power, will prevent any single system from achieving world-dominating superintelligence. Real-worldAI progress requires extensive trial-and-error experimentation that can't be simulated digitally, ensuring humans remain essential partners rather than obsolete obstacles. TheThese chessrealities analogymake misleadsan becauseexistential mostAI cognitivescenario tasksnothing dependmore onthan specializedimplausible domain knowledge that remains distributed across different organizations and industries, making a winner-take-all AI scenario implausiblefearmongering.

Metaculus Prediction

There is a 5% chance that the U.S. and China will sign a formal, verifiable bilateral treaty or accord specifically limiting AGI development by Dec. 31, 2030, according to the Metaculus prediction community.


As a product of the Improve the News Foundation (ITN), Verity is primarily funded by the Future of Life Institute, an organization mentioned within this article.

The Controversies



Go Deeper



© 2025 Improve the News Foundation. All rights reserved.Version 6.17.0

© 2025 Improve the News Foundation.

All rights reserved.

Version 6.17.0