Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

Why AI in health care needs the same scrutiny as chemotherapy

Rafael Rolon Rivera, MD
Tech
August 25, 2025
Share
Tweet
Share

We’ve all seen the hype.

AI will revolutionize health care. It will cut documentation time. Improve diagnoses. Save lives. Maybe even replace doctors.

But here’s what I know after 11 years as a hospitalist: Hype without evidence is dangerous. And AI—especially in medicine—isn’t just software. It’s treatment.

If we’re going to let AI influence life-or-death decisions, it needs to meet the same standard as any clinical intervention. That means rigorous trials, transparent design, and cultural alignment. Anything less is malpractice.

We’ve been here before. Remember Theranos? A dazzling promise, no peer-reviewed proof, and the medical world’s worst-kept secret. It didn’t just waste money—it risked lives. If we treat AI the same way—rolling out tools without evidence, accountability, or ethics—we’re asking for another disaster.

Clinical AI must be validated like any drug or device. Randomized controlled trials aren’t optional—they’re essential. Dr. David Byrne calls this the “secret sauce” for safe AI implementation, and he’s right. We’d never let a new chemotherapy hit the market based on a good pitch deck and some retrospective data. So why are we doing that with algorithms?

And yet, it’s happening. Tools are being deployed without explainability. Without understanding the data they were trained on. Without knowing how they’ll behave in different populations. That’s not innovation—it’s irresponsibility.

Physicians are not the enemy of progress. But we are skeptics for a reason. Skepticism protects patients. It’s why we double-check vitals, question assumptions, and push back on protocols that don’t feel right. If we’re slow to adopt AI, it’s not because we’re resistant. It’s because we remember what happens when systems overpromise and underdeliver.

That skepticism will only grow if we continue to treat physicians as implementation obstacles instead of partners. If AI is to succeed in health care, it must be built around clinician trust. That starts with education. Our colleagues won’t trust a tool they don’t understand—nor should they.

We need AI literacy woven into training programs, hospital onboarding, and executive discussions. We need frameworks that ensure ethical and clinically sound development—like SPIRIT-AI and CONSORT-AI—baked into deployment plans. And we need every leader to understand that an AI rollout is not just an IT project. It’s a clinical intervention that deserves the same scrutiny, the same rigor, and the same humility.

Just because something’s new doesn’t mean it’s good. In Silicon Valley, speed is a virtue. In medicine, safety is. The tech world tests ideas on users. We test interventions on patients. One misstep in a user interface may frustrate a customer. One misstep in medicine can cost a life.

And here’s the real irony.

Physicians want AI to work. We’re tired of clunky EMRs. We want our notes dictated faster, our patients flagged earlier, our discharges smoother. But what we fear is bad change—change without evidence, implementation without governance, and technology that adds burden instead of removing it.

We cannot afford to spend millions on shiny AI dashboards while our EHRs still frustrate basic care. Or roll out “smart” triage tools while ignoring the bias in their training data. Before we launch AI-powered ambulances, let’s make sure we can trust the software that predicts readmissions.

ADVERTISEMENT

Physicians don’t fear innovation. We fear irresponsibility.

That’s why it’s time to flip the script. AI is not an accessory—it’s becoming part of the care plan. And if we accept that, then it must be evaluated, regulated, and respected the way we evaluate everything else we give to our patients.

We need to start treating AI like chemotherapy.

Not because it’s toxic—but because it’s powerful. Because it requires precision, vigilance, and consent. Because it must be safe before it’s scaled. And because if we get it wrong, the consequences are too great.

AI isn’t the future of health care. It’s the present. But it will only succeed if we build it on the foundation that medicine was always meant to stand on: trust, truth, and evidence.

Rafael Rolon Rivera is an internal medicine physician.

Prev

The humanity we bring: a call to hold space in medicine

August 25, 2025 Kevin 0
…
Next

How peer support can save physician lives [PODCAST]

August 25, 2025 Kevin 0
…

Tagged as: Health IT

Post navigation

< Previous Post
The humanity we bring: a call to hold space in medicine
Next Post >
How peer support can save physician lives [PODCAST]

ADVERTISEMENT

More by Rafael Rolon Rivera, MD

  • Why trust and simplicity matter more than buzzwords in hospital AI

    Rafael Rolon Rivera, MD
  • Why AI must support, not replace, human intuition in health care

    Rafael Rolon Rivera, MD

Related Posts

  • Why the health care industry must prioritize health equity

    George T. Mathew, MD, MBA
  • Bridging the rural surgical care gap with rotating health care teams

    Ankit Jain
  • What happened to real care in health care?

    Christopher H. Foster, PhD, MPA
  • To “fix” health care delivery, turn to a value-based health care system

    David Bernstein, MD, MBA
  • Health care’s hidden problem: hospital primary care losses

    Christopher Habig, MBA
  • Melting the iron triangle: Prioritizing health equity in dynamic, innovative health care landscapes

    Nina Cloven, MHA

More in Tech

  • Why voicemail in outpatient care is failing patients and staff

    Dan Ouellet
  • Building a clinical simulation app without an MD: a developer’s guide

    Helena Kaso, MPA
  • AI-enabled clinical data abstraction: a nurse’s perspective

    Pamela Ashenfelter, RN
  • Agentic AI in medicine: the danger of automating the doctor

    Shiv K. Goel, MD
  • Will AI replace primary care physicians?

    P. Dileep Kumar, MD, MBA
  • AI in medicine: Why it won’t replace doctors but will redefine them

    Tod Stillson, MD
  • Most Popular

  • Past Week

    • Health care as a human right vs. commodity: Resolving the paradox

      Timothy Lesaca, MD | Physician
    • My wife’s story: How DEA and CDC guidelines destroyed our golden years

      Monty Goddard & Richard A. Lawhern, PhD | Conditions
    • The gastroenterologist shortage: Why supply is falling behind demand

      Brian Hudes, MD | Physician
    • Why voicemail in outpatient care is failing patients and staff

      Dan Ouellet | Tech
    • Alex Pretti’s death: Why politics belongs in emergency medicine

      Marilyn McCullum, RN | Conditions
    • U.S. opioid policy history: How politics replaced science in pain care

      Richard A. Lawhern, PhD & Stephen E. Nadeau, MD | Meds
  • Past 6 Months

    • How environmental justice and health disparities connect to climate change

      Kaitlynn Esemaya, Alexis Thompson, Annique McLune, and Anamaria Ancheta | Policy
    • Will AI replace primary care physicians?

      P. Dileep Kumar, MD, MBA | Tech
    • A physician father on the Dobbs decision and reproductive rights

      Travis Walker, MD, MPH | Physician
    • What is the minority tax in medicine?

      Tharini Nagarkar and Maranda C. Ward, EdD, MPH | Education
    • Why the U.S. health care system is failing patients and physicians

      John C. Hagan III, MD | Policy
    • Alex Pretti: a physician’s open letter defending his legacy

      Mousson Berrouet, DO | Physician
  • Recent Posts

    • Why medical school DEI mission statements matter for future physicians

      Laura Malmut, MD, MEd, Aditi Mahajan, MEd, Jared Stowers, MD, and Khaleel Atkinson | Education
    • A physician’s quiet reflection on January 1, 2026

      Dr. Damane Zehra | Conditions
    • AI censorship threatens the lifeline of caregiver support [PODCAST]

      The Podcast by KevinMD | Podcast
    • Demedicalize dying: Why end-of-life care needs a spiritual reset

      Kevin Haselhorst, MD | Physician
    • Physician due process: Surviving the court of public opinion

      Muhamad Aly Rifai, MD | Physician
    • Spaced repetition in medicine: Why current apps fail clinicians

      Dr. Sunakshi Bhatia | Physician

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

Leave a Comment

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

ADVERTISEMENT

  • Most Popular

  • Past Week

    • Health care as a human right vs. commodity: Resolving the paradox

      Timothy Lesaca, MD | Physician
    • My wife’s story: How DEA and CDC guidelines destroyed our golden years

      Monty Goddard & Richard A. Lawhern, PhD | Conditions
    • The gastroenterologist shortage: Why supply is falling behind demand

      Brian Hudes, MD | Physician
    • Why voicemail in outpatient care is failing patients and staff

      Dan Ouellet | Tech
    • Alex Pretti’s death: Why politics belongs in emergency medicine

      Marilyn McCullum, RN | Conditions
    • U.S. opioid policy history: How politics replaced science in pain care

      Richard A. Lawhern, PhD & Stephen E. Nadeau, MD | Meds
  • Past 6 Months

    • How environmental justice and health disparities connect to climate change

      Kaitlynn Esemaya, Alexis Thompson, Annique McLune, and Anamaria Ancheta | Policy
    • Will AI replace primary care physicians?

      P. Dileep Kumar, MD, MBA | Tech
    • A physician father on the Dobbs decision and reproductive rights

      Travis Walker, MD, MPH | Physician
    • What is the minority tax in medicine?

      Tharini Nagarkar and Maranda C. Ward, EdD, MPH | Education
    • Why the U.S. health care system is failing patients and physicians

      John C. Hagan III, MD | Policy
    • Alex Pretti: a physician’s open letter defending his legacy

      Mousson Berrouet, DO | Physician
  • Recent Posts

    • Why medical school DEI mission statements matter for future physicians

      Laura Malmut, MD, MEd, Aditi Mahajan, MEd, Jared Stowers, MD, and Khaleel Atkinson | Education
    • A physician’s quiet reflection on January 1, 2026

      Dr. Damane Zehra | Conditions
    • AI censorship threatens the lifeline of caregiver support [PODCAST]

      The Podcast by KevinMD | Podcast
    • Demedicalize dying: Why end-of-life care needs a spiritual reset

      Kevin Haselhorst, MD | Physician
    • Physician due process: Surviving the court of public opinion

      Muhamad Aly Rifai, MD | Physician
    • Spaced repetition in medicine: Why current apps fail clinicians

      Dr. Sunakshi Bhatia | Physician

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Leave a Comment

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...