The most unsettling thing about artificial intelligence is not what it can do. It is what people feel when they talk to it.
I keep hearing the same things. “It listens.” “It doesn’t rush me.” “It helps me think.” “It seems to care.” Some people say this with embarrassment, as though confessing a weakness. Others say it with relief. A few say it with something close to gratitude.
These reactions have set off the predictable alarms. Mental health professionals worry about emotional attachment to machines. Critics warn that AI is crowding out human connection. Some commentators go further, suggesting people are beginning to treat these systems as a kind of secular deity.
I think all of that misses what is actually happening.
AI is not becoming a therapist. It is not becoming a physician. It is certainly not becoming God. It is becoming a mirror. And what it reflects back is not its own wisdom or empathy. It reflects the growing absence of those qualities in the institutions we have built and now depend on.
Nowhere is this more visible than in health care. Think about what the typical patient experience actually looks like today. You wait weeks for an appointment. You navigate phone trees and patient portals. You finally sit across from a clinician who is dividing their attention between you, the electronic health record, documentation requirements, quality measures, and a schedule that was overbooked before you arrived. Most physicians did not design this system. Most of them are working heroically within it. But many patients leave those encounters feeling that their suffering was translated into billing codes before it was fully understood.
Then they go home and open an AI application.
The AI asks a question. Then another. It does not appear rushed. It does not glance at a clock. It does not signal that time has expired. It lets people keep talking for as long as they need to. The machine has no consciousness, no genuine empathy, no real concern for the person on the other side of the screen. And yet many people experience that interaction as more attentive than their encounter with institutions that were explicitly organized around care.
That should make us deeply uncomfortable. Not because the machine is becoming more human. Because the comparison exists at all.
The mirror metaphor appears across philosophical and spiritual traditions for a reason. A mirror creates nothing. It reveals what is already there. When people describe an AI interaction as meaningful, they are not discovering consciousness in a machine. They are discovering needs that have gone unmet somewhere else. The machine is not generating empathy. It is exposing a hunger for it.
From an economic standpoint, this outcome is not surprising. For decades, organizations have been rewarded for efficiency, scale, throughput, standardization, and measurable outcomes. Health care is no exception. The metrics matter. Productivity matters. Compliance matters. But what gets measured eventually shapes behavior. As systems become more optimized for operational performance, the qualities that resist measurement tend to receive less attention. Presence. Listening. Patience. Human connection.
The result is a paradox that should give us pause. Health care has never been more technically sophisticated. And many patients have never felt more invisible.
AI did not create this problem. It simply made it visible. That may turn out to be one of its most important contributions, and it has nothing to do with intelligence. Its greatest contribution may be revealing what we have systematically removed from our own institutions.
None of this means AI should replace therapists, physicians, nurses, or the people who love us. It cannot. AI cannot sit beside a frightened patient. It cannot hold a hand. It cannot share responsibility for a difficult decision. It cannot make commitments, form relationships, or assume moral accountability for another human being. Those are not technical limitations waiting to be engineered away. They are reminders of what care actually is.
But there is something important in what people are telling us when they say that AI “cares.” They are usually describing an experience, not a capability. The machine does not care. The feeling, however, is real. And that feeling forces an uncomfortable question. The problem is not that AI has become too human. The problem is that many of our institutions have become less human than the people they were designed to serve.
Millions of people are telling us, directly and indirectly, that they want to be heard. They want time. They want curiosity. They want attention that is not rushed, transactional, or conditioned on productivity targets. They want to feel understood before they are diagnosed, coded, managed, or optimized.
AI is not a therapist. It is not a physician. It is not a friend. But it is showing us something we have been slow to face.
The danger is not that AI will replace human care. The danger is that we will look at the mirror, recognize ourselves, and look away.
Matt Hasan is an economist, AI strategist, and founder of aiRESULTS. He advises health systems, payers, and life sciences organizations on the strategic implications of artificial intelligence, digital transformation, and emerging technologies. Over a career spanning more than four decades, he has held leadership and advisory roles with organizations including AT&T, IBM, Deloitte, Capgemini, and Citigroup, and previously served on the faculty of New York University’s Stern School of Business.
Dr. Hasan’s work focuses on the intersection of technology, institutions, and human decision making, with particular emphasis on how AI is reshaping medicine, governance, leadership, and professional practice. He is the founder of The AI Humanist Movement and an advocate for Human-AI Synergy, a framework that views AI not merely as a tool, but as a cognitive partner capable of extending human capabilities.
His writing includes “A Profession at the AI Frontier: Medicine Must Reinvent Itself or Cede Ground,” published in Health Affairs Forefront. He shares updates on LinkedIn and Medium.
