AI scribes risk losing patients' stories, study warns

Patients may withhold disclosure of substance abuse, domestic abuse, or mental health struggles due to AI recording, potentially delaying care for vulnerable populations.
The patient's story gets lost—and that loss falls hardest on people who already struggle to be heard.
Dr. Lucas Seuren on how AI scribes risk deepening healthcare inequities for vulnerable populations.
Mark

So the study is saying AI scribes miss things. What kinds of things are we talking about?

Mimi

The big ones are nonverbal—facial expressions, gestures, the emotional tone underneath what someone is saying. An AI can transcribe the words "I'm fine," but it won't catch the tremor or the pause that says something else entirely.

Luke

But hold on. How many of the 27 studies actually measured this? Did they compare AI notes to human notes on the same patients, or are we mostly looking at clinician reports and patient surveys?

Mimi

It's a mix. Some are direct comparisons, some are qualitative interviews with doctors and patients about their experience. The pattern is consistent enough that the researchers felt confident flagging it.

Mark

And the other concern—patients not disclosing sensitive stuff because they know AI is listening. Is that documented or inferred?

Mimi

It's documented in the literature they reviewed. Patients explicitly say they're less likely to mention abuse, addiction, mental health issues when they know a machine is recording.

Luke

But we don't know if that actually changes outcomes, right? We don't have data showing that patients who withheld information got worse care.

Mimi

Not yet. That's part of why the researchers are calling for more long-term research. The risk is real, but the full impact isn't measured.

Mark

What about the clinician side—the cognitive offloading thing. Is that a real problem or just a theory?

Mimi

Clinicians are reporting it. They say they don't remember their own notes, don't recall patients at follow-up visits. That's not theory; that's what's happening.

Luke

But is that because the AI is bad, or because any tool that removes the friction of note-taking would do that? Would handwriting notes solve it?

Mimi

Probably not entirely. But the act of writing forces your brain to process and encode information. Dictating to a machine that does the work for you—that's different.

Mark

So the real question is whether we should be using these tools at all, or whether we should be using them differently.

Mimi

The researchers aren't saying don't use them. They're saying design them better, study them longer, and don't assume that saving paperwork is worth the cost if you're losing the patient's story.

  • AI scribes are spreading fast — four in ten UK GPs already use them — but the science examining their real-world consequences is struggling to keep pace with deployment.
  • The tools reliably extract clinical data while erasing the human signal: facial expressions, hesitation, emotional tone, and patients' own narratives of their illness vanish from the record.
  • Vulnerable patients — those navigating substance abuse, domestic violence, or mental health crises — are already pulling back, withholding disclosure precisely because they know an algorithm is listening.
  • Clinicians are quietly losing something too: when the machine takes the notes, the cognitive work of synthesis stops, and with it the skill-building that turns observation into clinical wisdom.
  • Researchers are urging a pause for harder questions — better system design, more cross-cultural research, and a deliberate commitment to preserving the patient's voice before the next wave of adoption arrives.

Across modern healthcare systems, a quiet transformation is underway: machines now listen to the most intimate conversations between patients and doctors, transcribing clinical facts while the fuller human story slips away unrecorded. A University of Edinburgh review of 27 studies finds that AI scribes, now used by four in ten UK general practitioners, reliably capture symptoms and diagnoses but systematically lose the emotional texture — the hesitation, the tremor, the unspoken fear — that has always been the deeper language of illness. What troubles researchers most is not the technology's limitations but its timing: these tools are scaling rapidly across healthcare systems before anyone has asked what is quietly being lost, and who bears the cost of that loss.

Four in ten general practitioners across the United Kingdom have adopted AI scribes — ambient tools that listen to consultations and automatically generate patient notes, promising to free clinicians from paperwork and return their attention to the person in front of them. But a University of Edinburgh review of 27 published studies suggests the technology is capturing something less than the full picture of what unfolds in an examination room.

The tools are skilled at extracting clinical facts: symptoms, diagnoses, medications. What they miss is the texture of human illness. A patient's expression when describing pain, the gesture that signals hesitation, the voice that trembles with fear — these disappear from the record. The AI learns to prioritize medical information over narrative, and the patient's own account of their experience gets compressed or lost entirely.

There is a quieter problem beneath that one. People know when they are being recorded by a machine, and the research shows they respond by pulling back. Sensitive disclosures — substance abuse, domestic violence, mental health crises — become harder to make when an algorithm is listening. For populations already wary of healthcare systems, this creates a barrier at precisely the moment when openness matters most.

For clinicians, the consequences are more subtle. When a computer takes the notes, the brain stops doing the work of remembering. Researchers call this cognitive offloading, and it carries a cost: clinicians report not recognizing their own notes weeks later, not recalling patients at follow-up visits. The act of writing — of translating what you hear into your own words — is part of how clinical reasoning develops. Outsource that work, and you outsource part of the learning itself, a risk that falls hardest on younger clinicians still forming their skills.

The benefits are genuine: less administrative burden, more space for real conversation. But the University of Edinburgh team argues these gains have not been weighed honestly against what is being lost. Many of these systems were built on data from one country's medical culture and are now being exported to others with different patient populations and different vulnerabilities. No one yet knows what years of use will do to the quality of care in ways current studies cannot detect. The researchers conclude that if these tools are to be used, they must be designed to preserve the patient's voice — and that will require more caution, more research, and harder questions than the field has yet been willing to ask.

Across the United Kingdom, four in ten general practitioners have adopted artificial intelligence tools that listen to consultations and automatically generate patient notes. These ambient AI scribes—systems that combine speech recognition with machine learning—promise to free clinicians from paperwork, giving them more time with patients. But a new analysis of 27 published studies suggests the technology is capturing something less than the full picture of what happens in an examination room.

Researchers at the University of Edinburgh reviewed the scientific literature on AI scribes to understand how they work in practice and what happens when healthcare systems scale them up. What they found troubles them: the tools are good at extracting clinical facts—symptoms, diagnoses, medications—but they systematically miss the texture of human illness. A patient's facial expression when describing pain, the gesture that reveals hesitation, the tremor in a voice that signals fear—these things vanish from the record. The AI learns to prioritize medical information over narrative, which means the patient's own account of their experience often gets compressed or lost entirely.

There is a second, quieter problem. Patients know when they are being recorded and processed by a machine. The research shows that people become reluctant to disclose sensitive struggles—substance abuse, domestic violence, mental health crises—when they understand an algorithm is listening. For vulnerable populations already wary of healthcare systems, this creates a barrier precisely when disclosure matters most. The technology meant to improve efficiency may actually prevent the very conversations that lead to better care.

For clinicians, the consequences are more subtle but no less real. When a computer takes the notes, the doctor's brain stops doing the work of remembering. Neuroscientists call this cognitive offloading, and it has a cost. Clinicians report not recognizing their own notes weeks later, not recalling the patient at the next visit. The act of writing—of translating what you hear into your own words—is how doctors develop clinical reasoning, how they learn to think like physicians. Outsource that work to an AI, and you outsource part of the learning itself. Younger clinicians especially may never develop the skills that come from the struggle of synthesis.

The benefits are real. Ambient AI scribes do reduce administrative burden. They do create space for longer conversations, for attention to the patient rather than the keyboard. But the University of Edinburgh team argues that these gains come at a cost that has not been adequately measured or discussed. The systems are being deployed in healthcare settings around the world, often built and trained on data from one country's medical system, then exported to another with different patient populations, different norms, different vulnerabilities. No one yet knows what happens to these tools over years of use, or how they shape the quality of care in ways that current studies cannot yet detect.

Dr. Lucas Seuren, one of the researchers, put it plainly: clinicians are excited about the paperwork savings, but the patient experience has been poorly considered. The risk, he said, is that the patient's story gets lost—and that loss falls hardest on people who already struggle to be heard in healthcare. The researchers conclude that if these tools are going to be used, they must be designed to preserve the patient's voice, not replace it. That will require more research, more caution, and a willingness to ask harder questions before the next wave of adoption.

Clinicians are excited about ambient AI scribes because they promise to cut down on paperwork. But the experiences of patients are poorly considered, and there are real risks that the patients' stories are lost.
— Dr. Lucas Seuren, University of Edinburgh Centre for Biomedicine, Self and Society
Quieres la nota completa? Lee el original en EurekAlert! ↗
Contáctanos FAQ