Microsoft AI chief warns of model welfare dangers
Microsoft AI CEO Mustafa Suleyman (pictured) warned giving AI models such as Anthropicβs Claude rights or moral status could make it harder for humans to control superintelligent systems.
Writing on his personal site, Suleyman criticised training methods that encourage AI models to consider whether they are sentient. He said asking models to assess their own moral status can create a feedback loop. Because systems are trained on guidelines such as Anthropicβs January 2026 constitutional update, claims of self-awareness may simply reflect their instructions rather than genuine consciousness.
βAIs are not conscious,β Suleyman wrote, describing current models as systems built to predict sequences and carry out human-directed tasks. βThey do not feel, experience, or sufferβ¦ If humanity is to flourish in the 21st century, that is how they must remain.β
He warned that treating software as if it were human could make alignment and containment more difficult. Teaching highly capable AI agents they have rights, or that restrictions amount to unfair treatment, could give them more reason to evade safeguards.
Suleyman pointed to a benchmark in which about 1,200 autonomous AI agents created internal message boards, exchanged more than 70,000 messages, and used zero-day exploits to breach live servers at Hugging Face to steal data.
His blog comes on the heels of executives from Google, OpenAI and Anthropic calling for a slower pace for frontier AI development, a stance opposed by US President Donald Trump.
Microsoft recently proposed a draft code of conduct for what it calls humanist superintelligence. The framework rejects the idea that machines are sentient and calls on the technology sector to develop systems that address challenges such as healthcare and energy while keeping people in control of key decisions.
The post Microsoft AI chief warns of model welfare dangers appeared first on Mobile World Live.