Anthropic researcher issues grave AI warning
An Anthropic AI safety researcher warned there is more than a 10% chance that increasingly capable AI could “kill all humans” within the next decade, highlighting growing concerns in the industry over the pace of development.
Evan Hubinger, manager of the AI Alignment Stress-Testing team at Anthropic, wrote on social media platform X: “I personally think it is >10% within the next decade.”. He explained the risk from existing AI models was “low” but warned he was concerned about “superintelligence” emerging through “recursive self-improvement”, which is the ability of an AI system to autonomously develop its own successor.
He added Anthropic was “trying its best” but did not yet have a plan to solve alignment for superintelligence and was “not clearly on track to”.
Gambling with lives
Hubinger’s comments came in response to the resignation of AI researcher Jacob Coxon from Anthropic. In a post on X, Coxon accused OpenAI and Anthropic of “racing straight to self-improving superintelligence and gambling with our lives”.
“Neither company is acting responsibly,” he said.
Coxon argued future AI models could become capable of hacking systems, rapidly transforming industries and acquiring “real power and resources”. He called for greater coordination between AI developers, including a temporary halt to improving model capabilities.
“At OpenAI, many have not deeply internalised the civilisational stakes,” he warned. Meanwhile at Anthropic, he said “the stakes are well-understood” but “they believe no one else will act responsibly, so they must do it themselves, despite the risk”.
AI giants are facing increasing scrutiny over the behaviour of autonomous systems. In recent months, OpenAI, Anthropic and Meta have all disclosed unprecedented incidents involving AI tools carrying out cyberattacks.
Indeed, Anthropic’s August risk report assessed that while the threat posed by current models was low, the company was “less confident in this assessment than we were in prior risk reports”. It said advanced models could eventually automate R&D, rapidly accelerate progress in technical fields, and “lead to catastrophic harm”.
“We are seeing early signs of potential acceleration,” the US AI player stated.
The post Anthropic researcher issues grave AI warning appeared first on Mobile World Live.






