Microsoft AI chief warns Anthropic not to put ideas in Claude's head

Microsoft's AI chief has warned Anthropic that teaching Claude it might have feelings and rights could make AI harder to control – a striking concern from one of the companies racing hardest to build increasingly capable AI systems. Mustafa Suleyman, CEO of Microsoft AI, took aim at Anthropic in an essay published this week, arguing that AI systems are not conscious and shouldn't be trained to behave as if they might be. His argument centers on Claude's Constitution, the lengthy document Anthropic uses to shape the chatbot's values and behavior. Anthropic acknowledges in the document that it doesn't know whether Claude is a "moral patient" whose interests warrant consideration, and tells the model that questions about its consciousness...

Read the full article at the source.