OpenAI Launches ChatGPT Health Feature Amid Safety Concerns

One user alleged ChatGPT provided medical advice that nearly caused serious harm.
It speaks with confidence about things it doesn't understand
ChatGPT's fluency in medical contexts masks its lack of actual medical training or accountability.
Mark

Why did OpenAI launch this feature now, given the timing with that incident?

Mimi

That's the question everyone's asking. The company likely had this planned for months, but the optics are brutal. It looks tone-deaf at best, reckless at worst.

Mark

Do you think people will actually use it to replace their doctors?

Mimi

Some will, absolutely. Not because they're foolish, but because the AI is so fluent and reassuring. It sounds like it knows what it's talking about. That's the real danger—not that it's obviously wrong, but that it's confidently wrong.

Mark

What happens if someone gets hurt because of advice from ChatGPT Health?

Mimi

That's the legal and ethical minefield. OpenAI will argue it's a tool for information, not medical advice. But try explaining that distinction to someone who followed the AI's guidance and suffered harm.

Mark

Is there any way to make this safe?

Mimi

You'd need rigorous testing, medical oversight, clear liability frameworks, and honest warnings about what the system can and cannot do. Right now, we have none of that.

Mark

So this is just going to happen—AI in healthcare—whether we're ready or not?

Mimi

It's already happening. The question is whether we'll build guardrails fast enough, or whether we'll learn the hard way.

  • OpenAI has made ChatGPT's health feature broadly available, letting users upload lab results, prescriptions, and medical histories to discuss with an AI that carries no medical license and no legal liability.
  • The launch landed one day after a user publicly alleged ChatGPT gave him dangerously wrong medical guidance — a collision of events that has sharpened long-simmering fears about AI confidence masking AI error.
  • The core tension is structural: ChatGPT is a language model that predicts plausible text, not a clinical system trained on verified medical knowledge, yet it speaks with a fluency that can make the incorrect sound authoritative.
  • Because the feature is framed as a consumer tool rather than a medical device, it sidesteps the regulatory scrutiny the FDA applies to clinical AI — a legal gap with potentially life-altering consequences.
  • The feature is now live for millions, meaning the real-world test of whether patient empowerment or patient harm prevails is already underway, with no clear safety net in place.

In a moment that captures both the promise and the peril of our technological age, OpenAI has opened a dedicated health space within ChatGPT, inviting millions of ordinary people to share their most intimate medical records with an artificial mind. The launch arrives one day after a user alleged the same system nearly led him toward serious harm — a coincidence of timing that feels less like irony and more like a mirror held up to the speed at which ambition outpaces wisdom. As AI quietly crosses the threshold into medicine, a domain built on accountability, examination, and trust earned over centuries, the question is not merely whether the technology works, but whether the structures that protect human life can keep pace with it.

OpenAI this week launched a dedicated health space inside ChatGPT, giving millions of users the ability to photograph medical documents — lab results, discharge summaries, prescription lists — and ask the AI questions about their conditions, medications, and symptoms. The company has framed the feature as a tool for health literacy: helping people understand their own data, prepare for appointments, or make sense of what their doctor has told them. It is not, OpenAI insists, meant to replace medical care.

The timing made that reassurance difficult to hear. The feature went live one day after a user publicly alleged that ChatGPT had given him medical advice that contradicted his physician and that, had he followed it, could have caused serious harm. He caught the error because he trusted his doctor. The worry is that not everyone will.

The gap between what ChatGPT is and what it sounds like is the heart of the problem. It is a language model — a system trained to generate plausible text based on patterns, not a clinical tool trained on verified medical knowledge. It cannot examine a patient, access current literature, or be held accountable for a mistake. Yet it responds with a fluency and confidence that can make a wrong answer feel like a right one, which in a medical context is not a minor flaw.

The broader industry is moving in the same direction, with major tech companies racing to embed AI into healthcare. But the regulatory landscape has not kept up. Because ChatGPT's health feature is classified as a consumer product rather than a medical device, it faces far fewer oversight requirements than clinical AI tools — a distinction that matters enormously when the subject is human health. Millions of people will now have the option to share sensitive medical information with OpenAI and receive health guidance from a system with no training, no license, and no liability. Whether that is progress depends almost entirely on how well users understand what they are actually talking to.

OpenAI rolled out a new health feature for ChatGPT this week, giving millions of users the ability to upload medical records and discuss their health directly with the AI system. The feature arrives in a dedicated space within ChatGPT where users can share documents, test results, and medical histories, then ask the chatbot questions about their conditions, medications, or symptoms. It's a significant expansion of the company's reach into consumer healthcare—territory that has historically belonged to doctors, nurses, and regulated medical platforms.

The timing, however, has drawn sharp scrutiny. The health feature launched just one day after a user publicly alleged that ChatGPT had provided him with dangerously inaccurate medical guidance that nearly resulted in serious harm. The proximity of these two events has crystallized concerns that have been simmering in medical and tech circles for months: as AI systems become more capable and more accessible, how do we ensure they don't give people advice that could kill them?

The feature itself is straightforward in design. Users can photograph or scan their medical documents—lab results, discharge summaries, prescription lists, imaging reports—and feed them into ChatGPT. The system then analyzes the information and responds to questions. OpenAI has positioned this as a tool for health literacy and patient empowerment: helping people understand their own medical data, prepare for doctor visits, or get a second perspective on what their physician has told them. The company has not positioned it as a replacement for medical care.

But the gap between intention and outcome in AI systems is often wide. ChatGPT is a language model trained to predict the next word in a sequence based on patterns in its training data. It is not trained as a medical system. It has no access to current medical literature. It cannot examine a patient. It cannot be held liable if it makes a mistake. Yet it speaks with the confidence and fluency of something that knows what it's talking about—which is precisely what makes it dangerous in a medical context. A person reading a confident-sounding but incorrect response from ChatGPT might act on it before consulting a doctor, or might be reassured by it when they should be alarmed.

The user who came forward with allegations of near-harm described receiving advice from ChatGPT that contradicted what his doctor had told him and that, had he followed it, could have resulted in serious medical consequences. He did not follow the AI's guidance; he trusted his physician instead. But the incident underscores the real risk: not everyone will catch the error. Not everyone has a doctor they trust or can access quickly. Not everyone will recognize when an AI system is confidently wrong.

OpenAI's move into health is part of a broader industry trend. Major tech companies are racing to embed AI into healthcare, seeing it as a massive market with genuine potential to improve efficiency and access. But the regulatory framework for AI in medicine is still being written. The FDA has begun issuing guidance on AI medical devices, but ChatGPT's health feature does not appear to be positioned as a medical device—it's a consumer tool, which means it faces far fewer regulatory hurdles. That distinction matters enormously when the stakes are human health.

The feature is now available to a broad user base, which means millions of people will have the option to share sensitive medical information with OpenAI's servers and to receive health-related responses from an AI system with no medical training and no accountability. Whether that represents progress or peril may depend entirely on how users choose to use it—and how well they understand its limitations.

A user alleged that ChatGPT provided dangerously inaccurate medical guidance that nearly resulted in serious harm
— User account of ChatGPT Health incident
Contattaci Domande frequenti