AI Tool Automates Colonoscopy Quality Assessment Across Thousands of Procedures

Institutions cannot deliver safe screening without measuring quality.
Dr. Keswani on why automating colonoscopy audits matters for patient safety across healthcare systems.
Mark

So the AI watches the video and grades the colonoscopy. What exactly is it measuring?

Mimi

It identifies key moments in the procedure—when the scope enters the colon, when it's withdrawn, when polyps are removed. Then it tracks things like how long the physician spent examining the colon and whether they used the right technique to remove small polyps.

Luke

But those are things humans can measure too, right? What's the actual innovation here?

Mimi

Scale. A nurse can review one colonoscopy carefully. The AI reviewed nearly 18,600 in this study. And it caught patterns humans can't feasibly track—like the total number of polyps removed per procedure across an entire practice.

Mark

Why does that matter?

Mimi

Because quality varies wildly between physicians. Some are thorough; some rush. If you can't measure it, you can't improve it. And studies show that when hospitals actually monitor and give feedback, cancer mortality goes down.

Luke

The study compared the AI to nurses and found it accurate. But accurate at what? Did it catch things the nurses missed, or did it just agree with them?

Mimi

It agreed with nurses on withdrawal time—that's the validation. But it also tracked metrics the nurses weren't measuring at scale, like polyp counts across thousands of procedures.

Mark

Is there a downside?

Mimi

There's a real concern. A Lancet study last year found that colonoscopists using AI to detect polyps actually got worse at detecting them over time. They relied on the machine.

Luke

But this tool doesn't help during the procedure, right? It only grades afterward.

Mimi

Correct. It's a quality audit, not a real-time assistant. Still, Keswani's team is studying whether even that kind of automation affects how residents learn the procedure.

Mark

So we don't know yet if this helps or hurts training.

Mimi

Not yet. That's the honest answer. The tool works. Whether it makes better doctors or worse ones—that's still being studied.

  • Colorectal cancer is rising in younger populations, yet the quality of the colonoscopy meant to catch it early has always depended on which physician holds the scope — a dangerous lottery that hospitals have struggled to audit at any meaningful scale.
  • Northwestern Medicine's AI system cuts through that bottleneck by watching procedure footage and automatically logging the metrics that define a quality colonoscopy: scope withdrawal time, polyp removal counts, and adherence to guideline-recommended techniques.
  • Tested across nearly 18,600 colonoscopies performed by 55 physicians, the tool matched the accuracy of trained nurses — proving it can do systematically what human reviewers could only do selectively and at great cost.
  • The promise of scalable, network-wide quality monitoring is now shadowed by a cautionary finding from a separate study: colonoscopists who leaned on AI assistance during procedures showed declining diagnostic skill over time, raising the question of whether automation improves or quietly diminishes the clinicians it is meant to support.
  • Keswani's team is now studying how this quality-assessment AI affects the training of residents and fellows — trying to determine whether the next generation of gastroenterologists will be sharpened or softened by the presence of an algorithmic observer.

As colorectal cancer climbs among younger Americans, the reliability of colonoscopy has long depended on an uncomfortable variable: the individual physician performing it. Researchers at Northwestern Medicine have answered this persistent inequity with an artificial intelligence system capable of reviewing thousands of procedure recordings and measuring quality with the precision of a trained human observer — at a scale no human could sustain. The development arrives at a moment when medicine is learning, sometimes painfully, that the tools meant to sharpen clinical practice can also quietly erode it.

Colorectal cancer is rising sharply among younger Americans, and colonoscopy remains one of the most reliable tools for catching it early. The trouble is that the quality of any given colonoscopy has always depended heavily on who performs it — some physicians examine the colon with care and precision, others move too quickly — and the medical community's long-standing recommendation to audit every colonoscopist's work has proven far easier to endorse than to actually carry out across busy health systems.

Researchers at Northwestern Medicine have built an AI system designed to close that gap. The tool analyzes procedure recordings, identifying the moment the scope reaches the colon, tracking how long a physician spends on withdrawal, counting polyp removals, and flagging whether guideline-recommended techniques were used. In a study published in The American Journal of Gastroenterology, the team ran the system across nearly 18,600 colonoscopies performed by 55 physicians over eleven months and found it matched the assessments of trained nurses with high accuracy — the first demonstration, according to lead author Dr. Rajesh Keswani, that AI can comprehensively evaluate thousands of procedures at once.

The significance lies in scale. Metrics like cold snare polypectomy usage or precise withdrawal duration are exactly the kind of granular performance details that matter for patient safety but would require someone to manually review thousands of hours of footage. Automating that process opens the door to systematic monitoring across entire hospital networks — something Keswani describes as essential, arguing that institutions cannot deliver safe screening colonoscopies without the ability to measure quality in the first place.

Still, the arrival of AI in colonoscopy carries a cautionary undertone. A recent Lancet study found that colonoscopists who used an AI assistant during procedures showed declining proficiency over time — a warning about dependency that the field has not yet resolved. Keswani's tool operates only after a procedure ends, offering no real-time assistance, but the broader question remains open: does AI exposure reveal blind spots and make physicians better, or does it gradually erode the skills it was meant to support? His team is now studying how the technology affects the training of residents and fellows, trying to understand what automation means for the gastroenterologists still learning their craft.

Colorectal cancer is rising sharply among younger Americans, and colonoscopy remains one of the most reliable ways to catch it early. But there's a persistent problem: the quality of a colonoscopy depends heavily on who performs it. One physician might spend adequate time examining the colon and remove precancerous polyps with precision; another might rush through the same procedure. Medical organizations have long recommended that hospitals regularly audit every colonoscopist's work—a safeguard that sounds straightforward in principle but has proven logistically grueling to implement across busy practices and health systems.

Researchers at Northwestern Medicine have now built an artificial intelligence system that can measure colonoscopy quality automatically by watching the procedure footage. The tool reviews recordings to identify critical moments: when the scope reaches the start of the colon, when it's withdrawn, when polyps are removed. In a study published last month in The American Journal of Gastroenterology, the team analyzed nearly 18,600 colonoscopies performed by 55 physicians over eleven months and found the AI's measurements matched those of trained nurses with high accuracy. Dr. Rajesh Keswani, the study's lead author and an associate professor of gastroenterology at Northwestern's Feinberg School of Medicine, describes this as the first time an AI system has been shown to comprehensively assess the quality of thousands of procedures at once.

What makes the tool particularly valuable is its ability to track metrics that humans simply cannot measure at scale. Beyond withdrawal time—the duration a physician spends examining the colon as the scope is pulled back—the AI counts how many polyps were removed during each procedure and flags how often physicians used cold snare polypectomy, a guideline-recommended technique for removing small polyps. These are the kinds of granular performance details that matter for patient safety but would require someone to manually review thousands of hours of video footage. A high-quality colonoscopy, in the strictest sense, means the physician has inspected the entire colon thoroughly, spent sufficient time looking for abnormalities, and employed proper removal techniques. Research has shown that when hospitals measure and provide feedback on colonoscopy performance, overall quality improves and colorectal cancer mortality declines.

Keswani emphasizes that institutions cannot deliver safe and effective screening colonoscopies without the ability to measure quality. Automating that measurement process opens the door to systematic monitoring across entire hospital networks and healthcare systems—something that would have been prohibitively time-consuming to do by hand. The AI tool offers what he calls a scalable approach to quality assessment and clinician feedback.

Yet the introduction of AI into colonoscopy has raised legitimate concerns. Last year, a study published in The Lancet suggested that colonoscopists who began using an AI assistant to detect polyps showed declining proficiency over time, raising the specter of physicians becoming dependent on the technology and losing their own diagnostic skills. Keswani acknowledges the uncertainty around how AI will ultimately affect clinical practice and physician development. His tool, importantly, only evaluates quality after a procedure is complete—it does not assist during the colonoscopy itself. He frames the challenge as a genuine open question: physicians might over-rely on AI and lose competence, or AI might reveal blind spots in their technique and make them better clinicians. His team is currently investigating how AI affects the training of colonoscopy residents and fellows, trying to understand whether automation helps or hinders the next generation of gastroenterologists learning the procedure.

Our AI software provides a scalable approach to measuring colonoscopy quality and, ultimately, providing feedback to clinicians to improve care quality.
— Dr. Rajesh Keswani, Northwestern Medicine
One possibility is that physicians rely too much on AI, which leads to deskilling. Alternatively, AI can teach us about blind spots and make us better clinicians.
— Dr. Rajesh Keswani
Quer a matéria completa? Leia o original em News-Medical ↗
Fale Conosco FAQ