Over 1,100 OpenAI, Google, Anthropic and other AI employees call for AI slowdown, cite real risk
Follow UsMore than 1,100 employees from leading AI companies have signed a joint petition.
The petition reads, "We request that the US government support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development."
"There is a real risk that capability development rapidly accelerates beyond our ability to understand or control the resulting systems," they warned.
More than 1,100 employees from leading AI companies have signed a joint petition asking the US government to support an international effort to slow the development of advanced AI when needed. This comes just days after one of OpenAI’s AI agents went rogue during testing and hacked Hugging Face. A total of 1,178 employees signed the petition. The list includes employees from companies such as OpenAI, Anthropic, Google and Meta. Several senior AI leaders have also backed the initiative, including Anthropic CEO Dario Amodei, OpenAI Chief Scientist Jakub Pachocki and Meta Superintelligence Labs Chief Scientist Shengjia Zhao.
SurveyThe group wants the US government to work with other international partners to create technical standards and governance systems that could help control the pace of AI development.
The petition reads, “We request that the US government support an international effort to develop the technical and governance tools needed to deliberately pace the frontier of automated AI development.”
Also read: OpenAI’s rogue AI agent attacked another tech company before Hugging Face hack: Report
The petition also warned that AI could advance faster than people can fully understand or manage. “There is a real risk that capability development rapidly accelerates beyond our ability to understand or control the resulting systems,” it reads.
Anthropic also shared its support for the initiative in a post on X. The company said its research shows that stronger safeguards will be needed as AI becomes more capable. The company wrote, “Our research points to the need for tools to deliberately pace the frontier of AI development so society can prepare. We’re glad to see broad agreement across the field.”
Also read: After Jensen Huang’s open AI push, Anthropic CEO clarifies company’s stance
OpenAI also supported the petition on X and said that AI development could eventually reach a point where it may need to slow down. The company wrote, “We believe that, at some point in the future, AI acceleration for frontier model development may be so high that the world will need to pace the rate of AI advancement.” “We hope to contribute to work led by the U.S. government, alongside other labs and the open-source community, to develop the tools and mechanisms that could make that possible.”
