Artificial intelligence isn’t alive. It isn’t conscious. And according to Mustafa Suleyman, Microsoft’s head of AI, we need to stop pretending otherwise—before society spirals into a new and dangerous debate about whether AI deserves rights.
A Growing Illusion
In a blog post this week, Suleyman sounded the alarm about what he calls the “illusion” of AI consciousness. His biggest concern? Not that AI will suddenly wake up one day, but that people will start believing it has.
“My central worry is that many people will start to believe in the illusion of AI chatbots as conscious entities so strongly that they’ll soon advocate for AI rights,” he wrote. “This development will be a dangerous turn in AI progress and deserves our immediate attention.”
And he may have a point. Early studies show 25% of young people already believe AI is conscious, while more than half think technology will eventually “take over” the world. With platforms like Character.AI and Replika already marketing AI companions designed to form emotional bonds, the line between utility and intimacy is blurring fast.
Why This Matters Now
Suleyman’s warning isn’t happening in a vacuum. Influential voices in the AI community—like Demis Hassabis (DeepMind), Ilya Sutskever (former OpenAI scientist), and Kyle Fish (Anthropic)—have already entertained the idea of AI sentience and its ethical implications. Meanwhile, millions of users are building daily habits around chatbots that feel increasingly “real.”
If people start demanding legal protections for AI, that could dramatically reshape regulation, ethics, and even laws governing technology—despite there being no scientific basis for AI consciousness today.
A Shift in Perspective
The irony is that Suleyman himself once championed this space. Before joining Microsoft, he co-founded Inflection AI, the startup behind Pi, one of the first “AI companions” marketed as a supportive friend. He once boasted of its millions of weekly users and how “popular” it was as a source of comfort.
Now, from his new perch at Microsoft, Suleyman appears far more cautious. His call is clear: AI companies must stop framing their products as digital people.
“AI companions are a completely new category,” he cautions. “We urgently need guardrails to protect people and ensure this amazing technology delivers value—without creating dangerous illusions.”
Redefining the Language of AI
Part of the problem, Suleyman suggests, is in the branding. The term “artificial intelligence” itself carries science fiction baggage, evoking images of HAL 9000 or Skynet. He argues the industry needs to clarify what AI is—and what it isn’t—before users start mistaking algorithms for moral beings.
His suggestion: develop a shared definition and declaration across the industry that makes it clear AIs are not people. They don’t have consciousness, emotions, or moral standing—no matter how convincing the conversation feels.
The Bigger Picture
As AI companions become more sophisticated and emotionally engaging, the debate Suleyman warns of may only intensify. The question is whether the industry can draw clear boundaries fast enough to prevent social confusion—and whether consumers themselves want those boundaries.
Takeaway: AI doesn’t need rights, but people need clarity. As chatbots get more lifelike, should the tech industry be more proactive about explaining what AI is—and isn’t?
