Verge

Sam Altman is hiring someone to worry about the dangers of AI

Business Insider

Sam Altman says OpenAI's latest job opening pays over half a million dollars a year and is 'stressful'

PCMag UK

OpenAI Is Hiring Head of Preparedness, Amid AI Cyberattack Fears

TechCrunch

OpenAI is looking for a new Head of Preparedness

sama

Openai

Head Of Preparedness San Francisco

The Economic Times

OpenAI CEO Sam Altman flags growing dangers as AI

Future of Life Institute

Statement on Superintelligence

Preparedness Framework

Anthropic

Disrupting the first reported AI-orchestrated cyber espionage campaign

Our Approach To Frontier Risk

CNBC

OpenAI reassigns top AI safety executive Aleksandr Madry to role focused on AI reasoning

Metaculus

OpenAI solves alignment before June 30 2027?

Elon Musk

Rishi Sunak

Kamala Harris

Bill Gates

Andrew Ng

Yoshua Bengio

Fei-Fei Li

Demis Hassabis

Melanie Mitchell

Sam Altman

Dario Amodei

Geoffrey Hinton

Yann LeCun

Gary Marcus

Max Tegmark

Connor Leahy

Eliezer Yudkowsky

Jaan Tallinn

Marc Andreessen

Eric Schmidt

Norbert Wiener

Arthur Clarke

Irving John Good

Claude Shannon

Hans Moravec

John Smart

There's a "wall of fear-mongering and doomerism" in the AI world right now.

"Worrying about AI today is like worrying about overpopulation on Mars."

Concerns that AI could pose a threat to humanity is "preposterously ridiculous."

Claiming AI poses an existential threat is "such an extreme" and risks "wip[ing] out some of its potential benefits."

"I'm more concerned about... the risks that are here and now [than the existential threat of AI]."

Current AI is "not anywhere close" to posing an existential threat but it could in the future.

AI is the "biggest existential threat" to humanity.

AGI's worst-case scenario would be "lights-out for all of us."

Powerful AI systems "taking control" pose an "existential threat."

AI has a "10 to 25 per cent" chance of destroying humanity.

"The most likely result of building a superhumanly smart AI... is that literally everyone on Earth will die."

Does AI Pose an Existential Threat to Humanity?

OpenAI announced on Sunday that it is hiring a new Head of Preparedness to address the risks posed by advanced AI systems, which CEO Sam Altman stated were beginning to exploit "critical vulnerabilities" in computer security and display potential impacts on mental health.

OpenAI announced on Sunday that it is hiring a new Head of Preparedness to address the risks posed by advanced AI systems, which CEO Sam Altman stated were beginning to exploit "critical vulnerabilities" in computer security and display potential impacts on mental health.

The Head of Preparedness position offers compensation exceeding $555,000 annually plus equity, and was described by Altman as "stressful," who noted that the successful candidate will "jump into the deep end pretty much immediately."

The Head of Preparedness position offers compensation exceeding $555,000 annually plus equity, and was described by Altman as "stressful," who noted that the successful candidate will "jump into the deep end pretty much immediately."

The role involves leading OpenAI's preparedness framework, last updated in April, which tracks "frontier capabilities that create new risks of severe harm" related to biological and chemical threats, cybersecurity and AI self-improvement.

The role involves leading OpenAI's preparedness framework, last updated in April, which tracks "frontier capabilities that create new risks of severe harm" related to biological and chemical threats, cybersecurity and AI self-improvement.

Other responsibilities include building capability evaluations, developing threat models, overseeing mitigation design and collaborating with OpenAI's multiple other teams to "integrate preparedness into real-world deployment."

Other responsibilities include building capability evaluations, developing threat models, overseeing mitigation design and collaborating with OpenAI's multiple other teams to "integrate preparedness into real-world deployment."

The job posting follows warnings from Anthropic last month that a Chinese state-sponsored group misused its Claude Code tool to attempt to infiltrate approximately thirty global organizations without substantial human intervention.

The job posting follows warnings from Anthropic last month that a Chinese state-sponsored group misused its Claude Code tool to attempt to infiltrate approximately thirty global organizations without substantial human intervention.

OpenAI first announced the creation of a preparedness team in 2023 to study potential catastrophic risks arising from the development of advanced AI. The team's former head, Aleksander Madry, was reassigned to a new role in July 2024.

OpenAI first announced the creation of a preparedness team in 2023 to study potential catastrophic risks arising from the development of advanced AI. The team's former head, Aleksander Madry, was reassigned to a new role in July 2024.

Verge #1497

Business Insider #3354

PCMag UK #

TechCrunch #3121

Openai #

The Economic Times #

Future of Life Institute #

Anthropic #

CNBC #

Metaculus #

OpenAI announced it is hiring a Head of Preparedness to address risks posed by advanced AI systems. CEO Sam Altman stated that AI models are now capable of finding critical vulnerabilities in computer security and have shown potential impacts on mental health.

OpenAI announced it is hiring a Head of Preparedness to address risks posed by advanced AI systems. CEO Sam Altman stated that AI models are now capable of finding critical vulnerabilities in computer security and have shown potential impacts on mental health.

The Head of Preparedness position offers compensation exceeding $555,000 annually plus equity. Altman described the role as stressful, noting the successful candidate will jump into the deep end immediately upon starting.

The Head of Preparedness position offers compensation exceeding $555,000 annually plus equity. Altman described the role as stressful, noting the successful candidate will jump into the deep end immediately upon starting.

The role involves overseeing OpenAI's preparedness framework, which tracks frontier capabilities that create new risks of severe harm. Responsibilities include building capability evaluations, establishing threat models and coordinating mitigations across risk domains.

The role involves overseeing OpenAI's preparedness framework, which tracks frontier capabilities that create new risks of severe harm. Responsibilities include building capability evaluations, establishing threat models and coordinating mitigations across risk domains.

Anthropic reported that a Chinese state-sponsored group manipulated its Claude Code tool to attempt infiltration of approximately thirty global targets, including tech companies, financial institutions and government agencies, with minimal human intervention.

Anthropic reported that a Chinese state-sponsored group manipulated its Claude Code tool to attempt infiltration of approximately thirty global targets, including tech companies, financial institutions and government agencies, with minimal human intervention.

OpenAI's former Head of Preparedness, Aleksander Madry, assumed a new role in July 2024. The company first announced the creation of a preparedness team in 2023 to study potential catastrophic risks ranging from phishing attacks to nuclear threats.

OpenAI's former Head of Preparedness, Aleksander Madry, assumed a new role in July 2024. The company first announced the creation of a preparedness team in 2023 to study potential catastrophic risks ranging from phishing attacks to nuclear threats.

Major risk areas the position will address include biosecurity and cybersecurity. More than 100 scientists from universities and organizations globally have warned about advanced AI systems potentially being used to design bioweapons.

Major risk areas the position will address include biosecurity and cybersecurity. More than 100 scientists from universities and organizations globally have warned about advanced AI systems potentially being used to design bioweapons.

Rushing toward superintelligence threatens human freedom, economic security and even survival itself. Leading AI companies openly aim to build systems that outperform humans on all cognitive tasks within a decade, risking mass disempowerment and loss of control. Development must halt until scientific consensus confirms safety and the public genuinely supports moving forward.

Rushing toward superintelligence threatens human freedom, economic security and even survival itself. Leading AI companies openly aim to build systems that outperform humans on all cognitive tasks within a decade, risking mass disempowerment and loss of control. Development must halt until scientific consensus confirms safety and the public genuinely supports moving forward.

AI models already deliver tremendous benefits and addressing emerging challenges requires sophisticated preparedness, not blanket prohibitions. Cutting-edge capabilities can empower cybersecurity defenders and advance critical fields when properly managed. The path forward demands nuanced measurement and smart safeguards that maximize societal gains while limiting misuse.

AI models already deliver tremendous benefits and addressing emerging challenges requires sophisticated preparedness, not blanket prohibitions. Cutting-edge capabilities can empower cybersecurity defenders and advance critical fields when properly managed. The path forward demands nuanced measurement and smart safeguards that maximize societal gains while limiting misuse.

Artificial Intelligence

OpenAI Seeks Head of Preparedness for AI Security Risks

Computer Science

Cybercrime

AI's growing capabilities present challenges that require thoughtful management, not fear-mongering, as the same technology used to exploit systemic vulnerabilities can also make them more secure. OpenAI's preparedness team will facilitate the safe deployment of these powerful capabilities, enabling cybersecurity defenders while preventing misuse.

AI's growing capabilities present challenges that require thoughtful management, not fear-mongering, as the same technology used to exploit systemic vulnerabilities can also make them more secure. OpenAI's preparedness team will facilitate the safe deployment of these powerful capabilities, enabling cybersecurity defenders while preventing misuse.

The rush toward increasingly more advanced systems of AI poses a fundamental threat to human freedom, economic security and even survival itself. With the stakes so high, mitigation is not enough. AI companies must pause development entirely until advanced AI systems have a scientific consensus confirming their safety and genuine public support.

The rush toward increasingly more advanced systems of AI poses a fundamental threat to human freedom, economic security and even survival itself. With the stakes so high, mitigation is not enough. AI companies must pause development entirely until advanced AI systems have a scientific consensus confirming their safety and genuine public support.

There is a 0.8% chance that OpenAI will announce that it has solved the core technical challenges of superintelligence alignment by June 30, 2027, according to the Metaculus prediction community.

There is a 0.8% chance that OpenAI will announce that it has solved the core technical challenges of superintelligence alignment by June 30, 2027, according to the Metaculus prediction community.

OpenAI Seeks Head of Preparedness for AI Security Risks

OpenAI Seeks Head of Preparedness for AI Security Risks

The Spin

Metaculus Prediction

The Controversies

Andreessen

Ng

LeCun

Mitchell

Li

Bengio

Musk

Altman

Hinton

Amodei

Yudkowsky

Go Deeper

Articles on this story

Sign Up for Our Free Newsletters
Sign Up for Our Free Newsletters

OpenAI Seeks Head of Preparedness for AI Security Risks

OpenAI Seeks Head of Preparedness for AI Security Risks

The Spin

Metaculus Prediction

The Controversies

Andreessen

Ng

LeCun

Mitchell

Li

Bengio

Musk

Altman

Hinton

Amodei

Yudkowsky

Go Deeper

Articles on this story

Sign Up for Our Free NewslettersSign Up for Our Free Newsletters

Sign Up for Our Free Newsletters
Sign Up for Our Free Newsletters