Verge

California State Assembly passes sweeping AI safety bill

OpenAI and Anthropic will share their models with the US government

Elon Musk

Rishi Sunak

Kamala Harris

Bill Gates

Andrew Ng

Yoshua Bengio

Fei-Fei Li

Demis Hassabis

Melanie Mitchell

Sam Altman

Dario Amodei

Geoffrey Hinton

Yann LeCun

Gary Marcus

Max Tegmark

Connor Leahy

Eliezer Yudkowsky

Jaan Tallinn

Marc Andreessen

Eric Schmidt

Norbert Wiener

Arthur Clarke

Irving John Good

Claude Shannon

Hans Moravec

John Smart

There's a "wall of fear-mongering and doomerism" in the AI world right now.

"Worrying about AI today is like worrying about overpopulation on Mars."

Concerns that AI could pose a threat to humanity is "preposterously ridiculous."

Claiming AI poses an existential threat is "such an extreme" and risks "wip[ing] out some of its potential benefits."

"I'm more concerned about... the risks that are here and now [than the existential threat of AI]."

Current AI is "not anywhere close" to posing an existential threat but it could in the future.

AI is the "biggest existential threat" to humanity.

AGI's worst-case scenario would be "lights-out for all of us."

Powerful AI systems "taking control" pose an "existential threat."

AI has a "10 to 25 per cent" chance of destroying humanity.

"The most likely result of building a superhumanly smart AI... is that literally everyone on Earth will die."

Does AI Pose an Existential Threat to Humanity?

Approximately 120 current or former employees from AI and tech companies such as Anthrophic, Google, Meta, and OpenAI have signed a letter in support of California's AI regulation bill SB 1047.

Axios

SB 1047, authored by Democratic California State Sen. Scott Weiner, requires companies to test AI models and publicly disclose safety protocols in place to stop model manipulation – requiring the hiring of third-party auditors to oversee the process granting powers to sue developers who do not comply.

Verity

The letter provides support for the bill within person capacities, stating that AI models "may soon pose severe risks" including access to biological weapons and critical infrastructure attacks.

Call to Lead

The letter continues by claiming it to be "feasible and appropriate" for companies to test if AI models "can cause severe harms" and to create "reasonable safeguards" against potential threats.

The bill sees personal support within the letter from several employees whose companies that officially oppose its measures (Google, Meta, OpenAI). Having passed California's legislature Gov. Gavin Newsom must either sign or veto the bill by the end of the month.

Employees at Meta, OpenAI, Google, Sign SB1047 Support Letter

The Controversies

Andreessen

Ng

LeCun

Mitchell

Li

Bengio

Musk

Altman

Hinton

Amodei

Yudkowsky

Go Deeper

Articles on this story

Sign Up for Our Free Newsletters
Sign Up for Our Free Newsletters