AI note-taking tools for GPs risk missing crucial patient details, study warns

Vulnerable patients facing marginalization in healthcare may have their experiences and sensitive health information inadequately captured or disclosed.
The patients' stories are lost in the clinical data.
Researchers warn that AI scribes prioritize medical facts over patients' lived experiences, particularly harming vulnerable populations.
Mark

So these AI scribes are in four out of ten GP surgeries. That's a lot of consultations being recorded and transcribed. What's the actual problem if the notes are accurate?

Mimi

Accuracy of transcription isn't really the issue. The problem is what gets lost in translation—literally. A patient's facial expression when they mention a symptom, the tremor in their voice when they talk about something frightening. The algorithm doesn't see those things.

Luke

But hold on. Are we saying the AI is missing these cues, or that the notes are missing them? Because a human doctor taking handwritten notes would also miss some of that detail if they weren't paying attention.

Mimi

That's fair. But there's something else: patients themselves clam up when they know they're being recorded. Sensitive stuff—abuse, addiction, mental health—people don't disclose it to a machine the way they might to a doctor they trust.

Mark

And the doctors? The research mentions something about them losing skills?

Mimi

Yes. When the AI does the note-taking, clinicians stop doing that active mental work of processing what they've heard. Over time, their memory and judgment can suffer. Some doctors didn't even recognize their own notes.

Luke

That's a real concern, but I'd want to know: is that from long-term studies, or are these isolated cases? The research calls for more study on long-term impacts. So we don't actually know yet how bad this gets.

Mimi

True. But the researchers are clear about one thing: the patients most harmed by this are the ones already struggling to be heard in healthcare—vulnerable people, marginalized communities.

Mark

So the efficiency gain for doctors comes at a cost to patient voice?

Mimi

Exactly. And that cost isn't evenly distributed.

Luke

The real question is whether these systems can be redesigned to capture both the efficiency and the human detail. Right now, they're not doing that.

Mark

And they're already in use while that redesign is still theoretical?

Mimi

Yes. That's the gap.

  • AI scribes have spread rapidly across UK general practice, promising to free doctors from paperwork — but a major review now reveals the efficiency gains may be quietly hollowing out the quality of care.
  • Patients who know a machine is listening are holding back: sensitive disclosures about domestic violence, mental health, and substance abuse are going unspoken precisely when they matter most.
  • Clinicians are experiencing 'cognitive offloading' — the act of delegating note-taking to AI is eroding memory, clinical judgment, and in some cases doctors cannot even recall a patient who returns for follow-up.
  • The patients most harmed are those already marginalized — people whose complex, lived experiences are most easily flattened into clinical data points by systems not designed to hear them.
  • Researchers are not calling for these tools to be abandoned, but urgently redesigned — built to preserve the patient's voice rather than substitute for it, and studied far more rigorously before deeper adoption.

A quiet technological shift is underway in British primary care, where AI systems now transcribe the words spoken between doctors and patients in four out of ten GP surgeries — yet researchers at the University of Edinburgh warn that what these tools record and what actually matters in a consultation are not always the same thing. The unspoken dimensions of human suffering — a hesitation, a withheld disclosure, a face that tells a different story than the words — remain beyond the algorithm's reach. In capturing the clinical, these systems risk erasing the human, and those already least heard in healthcare may bear the greatest cost.

A technology now present in four out of ten GP surgeries across Britain is quietly reshaping what happens inside a medical consultation — not just how notes are written, but what gets noticed, remembered, and disclosed at all.

Ambient AI scribes listen to appointments, convert speech to text, and generate clinical records automatically. The appeal has been real: a clinic in Dudley saw its backlog of patient letters fall from six months to two weeks after adopting one such tool. Doctors spend less time typing and more time with patients. But researchers at the University of Edinburgh have published a detailed review suggesting the trade-off runs deeper than the efficiency gains first implied.

The systems capture what is said — not what is shown. Facial expressions, hesitation, visible distress, the emotional texture of an encounter: all of it remains invisible to the algorithm. The software tends to favour clinical facts over a patient's own account of their fears and lived experience. And patients who know they are being recorded become more guarded. Evidence gathered by the researchers shows people are less willing to disclose sensitive information — domestic violence, mental health struggles, substance misuse — when they know a machine is listening. These are often the details that change everything about how a doctor understands someone's situation.

The effect on clinicians is subtler but significant. Manual note-taking, the research suggests, is not merely administrative — it is a form of active mental engagement that sharpens memory and clinical reasoning. When AI absorbs that task, the cognitive load shifts in ways that accumulate quietly: memory recall declines, skills erode, and some clinicians reported not recognising their own notes or failing to remember a patient at a follow-up visit.

Dr. Lucas Seuren of the University of Edinburgh identified who bears the greatest risk: patients already marginalised within healthcare — those whose experiences are most easily reduced to data points, whose voices are already least likely to be heard. An AI that prioritises clinical information over patient narrative does not affect everyone equally; it deepens existing inequalities.

The researchers are not calling for these tools to be removed. They are calling for redesign — systems built to preserve the patient's voice rather than replace it, and far more study before wider adoption, especially in healthcare contexts different from those where the AI was originally trained. The technology is already embedded. The question is whether it will be rethought before its blind spots become permanent features of the clinical record.

A technology that has quietly entered four out of every ten GP surgeries across Britain is doing something its designers may not have fully reckoned with: it is changing what doctors hear, what patients say, and what actually gets written down about the encounter between them.

Ambient AI scribes—software that listens to consultations, transcribes speech into text, and generates clinical notes—have been adopted widely enough that they are now reshaping the texture of primary care. Doctors in the West Midlands reported last year that one such tool, called Heidi, had slashed their administrative load dramatically. At a clinic in Dudley, the backlog of patient letters waiting to be posted fell from six months to just two weeks. The appeal is obvious: clinicians spend less time typing, more time with patients, fewer evenings hunched over paperwork.

But researchers at the University of Edinburgh have now published a detailed review of how these systems actually work in practice, and their findings suggest the trade-off may be steeper than the efficiency gains first suggested. The team examined cases where ambient AI scribes were in use and identified a pattern of omission that runs through the technology's design: it captures what is said, but not what is shown. Facial expressions, gestures, the hesitation in a patient's voice, the visible signs of distress or relief—these remain invisible to the algorithm. The software tends to prioritize clinical facts over the patient's own account of their illness, their fears, their lived experience of what is happening to their body.

There is a human dimension to this that extends beyond mere documentation. Patients who know they are being recorded—that their words are being fed into an AI system, transcribed, stored—become more guarded. Researchers found evidence that people are less willing to disclose sensitive information when they know a machine is listening: substance abuse, domestic violence, struggles with mental health. These are precisely the details that matter most, the ones that change how a doctor understands a patient's situation. When the recording light is on, some patients simply do not speak them aloud.

The cognitive load on clinicians themselves shifts in ways that are not immediately obvious. Manual note-taking, the research suggests, serves a function beyond documentation. The act of writing forces a kind of active engagement with what a patient has said—a mental processing that aids memory, reasoning, and clinical judgment. When the AI takes over that task, clinicians experience what researchers call "cognitive offloading." The benefit is real: mental effort freed up for more complex thinking, for deeper conversation. But the cost accumulates quietly. Memory recall declines. Skills atrophy. In some cases, clinicians reported not recognizing their own notes when they reviewed them later, or failing to remember the patient when they returned for a follow-up appointment.

Dr. Lucas Seuren of the University of Edinburgh's Centre for Biomedicine, Self and Society framed the stakes plainly: the patients whose stories are most at risk of being lost are those already marginalized within healthcare systems—people whose experiences are easiest to reduce to clinical data points, whose voices are already least likely to be heard. An AI system that prioritizes clinical information over patient narrative does not affect all patients equally. It compounds existing inequalities.

The research, published in the British Medical Journal's digital health and AI publication, does not call for abandoning these tools. It calls for redesign. The systems need to be built in ways that preserve the patient's voice rather than replace it. They need to capture not just what was said, but the context in which it was said. And crucially, they need far more study—particularly in healthcare systems different from those where the AI was originally trained. The technology is already in use. The question now is whether it will be redesigned before its limitations become embedded in the clinical record.

Many clinicians are excited about ambient AI scribes because they promise to cut down on paperwork. But the experiences of patients are poorly considered, and there are real risks that the patients' stories are lost. This can further disadvantage people who already face marginalisation in health and social care services.
— Dr. Lucas Seuren, University of Edinburgh Centre for Biomedicine, Self and Society
Quieres la nota completa? Lee el original en BBC News ↗
Contáctanos FAQ