Is Anthropic Making Claude Too Human to Control?
Anthropicβs call to slow down AI development to keep humans safe has dominated the news cycle and drew similar calls from the leaders of OpenAI, Microsoft and others (and subtle disagreement from Mark Zuckerberg).Β
But Mustafa Suleyman, who runs Microsoftβs AI model development, has a warning about Anthropic itself.Β
Suleyman, who co-founded DeepMind (now part of Google), says Anthropicβs approach of treating its Claude models as if they were sentient, similar to humans, could produce a dangerous outcome. He called out Anthropicβs Claude Constitution, a document that treats the model as an intelligent entity and offers guidelines for how it should handle ethical dilemmas. Suleyman said that by incorporating the document into its training, Anthropic could make Claude harder to control.Β
Suleymanβs concerns emerged when Anthropic updated the constitution at the start of this year to leave room for the possibility that Claude has some sort of βconsciousnessβ or βmoral status,β a change from the original document.