Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

Why AI in health care needs the same scrutiny as chemotherapy

Rafael Rolon Rivera, MD
Tech
August 25, 2025
Share
Tweet
Share

We’ve all seen the hype.

AI will revolutionize health care. It will cut documentation time. Improve diagnoses. Save lives. Maybe even replace doctors.

But here’s what I know after 11 years as a hospitalist: Hype without evidence is dangerous. And AI—especially in medicine—isn’t just software. It’s treatment.

If we’re going to let AI influence life-or-death decisions, it needs to meet the same standard as any clinical intervention. That means rigorous trials, transparent design, and cultural alignment. Anything less is malpractice.

We’ve been here before. Remember Theranos? A dazzling promise, no peer-reviewed proof, and the medical world’s worst-kept secret. It didn’t just waste money—it risked lives. If we treat AI the same way—rolling out tools without evidence, accountability, or ethics—we’re asking for another disaster.

Clinical AI must be validated like any drug or device. Randomized controlled trials aren’t optional—they’re essential. Dr. David Byrne calls this the “secret sauce” for safe AI implementation, and he’s right. We’d never let a new chemotherapy hit the market based on a good pitch deck and some retrospective data. So why are we doing that with algorithms?

And yet, it’s happening. Tools are being deployed without explainability. Without understanding the data they were trained on. Without knowing how they’ll behave in different populations. That’s not innovation—it’s irresponsibility.

Physicians are not the enemy of progress. But we are skeptics for a reason. Skepticism protects patients. It’s why we double-check vitals, question assumptions, and push back on protocols that don’t feel right. If we’re slow to adopt AI, it’s not because we’re resistant. It’s because we remember what happens when systems overpromise and underdeliver.

That skepticism will only grow if we continue to treat physicians as implementation obstacles instead of partners. If AI is to succeed in health care, it must be built around clinician trust. That starts with education. Our colleagues won’t trust a tool they don’t understand—nor should they.

We need AI literacy woven into training programs, hospital onboarding, and executive discussions. We need frameworks that ensure ethical and clinically sound development—like SPIRIT-AI and CONSORT-AI—baked into deployment plans. And we need every leader to understand that an AI rollout is not just an IT project. It’s a clinical intervention that deserves the same scrutiny, the same rigor, and the same humility.

Just because something’s new doesn’t mean it’s good. In Silicon Valley, speed is a virtue. In medicine, safety is. The tech world tests ideas on users. We test interventions on patients. One misstep in a user interface may frustrate a customer. One misstep in medicine can cost a life.

And here’s the real irony.

Physicians want AI to work. We’re tired of clunky EMRs. We want our notes dictated faster, our patients flagged earlier, our discharges smoother. But what we fear is bad change—change without evidence, implementation without governance, and technology that adds burden instead of removing it.

We cannot afford to spend millions on shiny AI dashboards while our EHRs still frustrate basic care. Or roll out “smart” triage tools while ignoring the bias in their training data. Before we launch AI-powered ambulances, let’s make sure we can trust the software that predicts readmissions.

ADVERTISEMENT

Physicians don’t fear innovation. We fear irresponsibility.

That’s why it’s time to flip the script. AI is not an accessory—it’s becoming part of the care plan. And if we accept that, then it must be evaluated, regulated, and respected the way we evaluate everything else we give to our patients.

We need to start treating AI like chemotherapy.

Not because it’s toxic—but because it’s powerful. Because it requires precision, vigilance, and consent. Because it must be safe before it’s scaled. And because if we get it wrong, the consequences are too great.

AI isn’t the future of health care. It’s the present. But it will only succeed if we build it on the foundation that medicine was always meant to stand on: trust, truth, and evidence.

Rafael Rolon Rivera is an internal medicine physician.

Prev

The humanity we bring: a call to hold space in medicine

August 25, 2025 Kevin 0
…
Next

How peer support can save physician lives [PODCAST]

August 25, 2025 Kevin 0
…

Tagged as: Health IT

Post navigation

< Previous Post
The humanity we bring: a call to hold space in medicine
Next Post >
How peer support can save physician lives [PODCAST]

ADVERTISEMENT

More by Rafael Rolon Rivera, MD

  • Why trust and simplicity matter more than buzzwords in hospital AI

    Rafael Rolon Rivera, MD
  • Why AI must support, not replace, human intuition in health care

    Rafael Rolon Rivera, MD

Related Posts

  • Why the health care industry must prioritize health equity

    George T. Mathew, MD, MBA
  • Bridging the rural surgical care gap with rotating health care teams

    Ankit Jain
  • What happened to real care in health care?

    Christopher H. Foster, PhD, MPA
  • To “fix” health care delivery, turn to a value-based health care system

    David Bernstein, MD, MBA
  • Health care’s hidden problem: hospital primary care losses

    Christopher Habig, MBA
  • Melting the iron triangle: Prioritizing health equity in dynamic, innovative health care landscapes

    Nina Cloven, MHA

More in Tech

  • Reinforcing trust in AI: a critical role for health tech leaders

    Miles Barr
  • The digital divide in rural health care

    Jason Griffin, MBA
  • One doctor’s journey to making an AI study tool less corrosive to critical thinking

    Mark Lee, MD
  • Is it time to embrace augmented empathy while using artificial intelligence in health care?

    Vanessa D‘Amario, PhD & Vijay Rajput, MD
  • AI in your health care: a double-edged digital disruptor

    Alan P. Feren, MD
  • Why the future of AI in medicine is patient-facing

    Colin Son, MD
  • Most Popular

  • Past Week

    • The mental health workforce is collapsing

      Ronke Lawal | Conditions
    • The measure of a doctor, the misery of a patient

      Anonymous | Physician
    • A doctor’s struggle with burnout and boundaries

      Humeira Badsha, MD | Physician
    • The stoic cure for modern anxiety

      Osmund Agbo, MD | Physician
    • The role of faith and culture in patient recovery

      Monzur Morshed, MD and Kaysan Morshed | Physician
    • Living with the uncertainty of surviving stage 4 cancer [PODCAST]

      The Podcast by KevinMD | Podcast
  • Past 6 Months

    • Rethinking the JUPITER trial and statin safety

      Larry Kaskel, MD | Conditions
    • The ignored clinical trials on statins and mortality

      Larry Kaskel, MD | Conditions
    • How one physician redesigned her practice to find joy in primary care again [PODCAST]

      The Podcast by KevinMD | Podcast
    • Why doctors must fight for a just health care system

      Alankrita Olson, MD, MPH & Ashley Duhon, MD & Toby Terwilliger, MD | Policy
    • The human case for preserving the nipple after mastectomy

      Thomas Amburn, MD | Conditions
    • IMGs are the future of U.S. primary care

      Adam Brandon Bondoc, MD | Physician
  • Recent Posts

    • Are doctors’ emotions fueling the opioid crisis?

      Brian Lynch, MD | Conditions
    • A medical student’s journey to Tanzania

      Giana Nicole Davlantes | Education
    • How therapy helps uncover hidden patterns that shape our lives [PODCAST]

      The Podcast by KevinMD | Podcast
    • Focal therapy for prostate cancer: a new option

      Louis S. Liou, MD, PhD | Conditions
    • The power of ordinary joy for physician well-being

      Ben Reinking, MD | Physician
    • Reinforcing trust in AI: a critical role for health tech leaders

      Miles Barr | Tech

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

Leave a Comment

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

ADVERTISEMENT

  • Most Popular

  • Past Week

    • The mental health workforce is collapsing

      Ronke Lawal | Conditions
    • The measure of a doctor, the misery of a patient

      Anonymous | Physician
    • A doctor’s struggle with burnout and boundaries

      Humeira Badsha, MD | Physician
    • The stoic cure for modern anxiety

      Osmund Agbo, MD | Physician
    • The role of faith and culture in patient recovery

      Monzur Morshed, MD and Kaysan Morshed | Physician
    • Living with the uncertainty of surviving stage 4 cancer [PODCAST]

      The Podcast by KevinMD | Podcast
  • Past 6 Months

    • Rethinking the JUPITER trial and statin safety

      Larry Kaskel, MD | Conditions
    • The ignored clinical trials on statins and mortality

      Larry Kaskel, MD | Conditions
    • How one physician redesigned her practice to find joy in primary care again [PODCAST]

      The Podcast by KevinMD | Podcast
    • Why doctors must fight for a just health care system

      Alankrita Olson, MD, MPH & Ashley Duhon, MD & Toby Terwilliger, MD | Policy
    • The human case for preserving the nipple after mastectomy

      Thomas Amburn, MD | Conditions
    • IMGs are the future of U.S. primary care

      Adam Brandon Bondoc, MD | Physician
  • Recent Posts

    • Are doctors’ emotions fueling the opioid crisis?

      Brian Lynch, MD | Conditions
    • A medical student’s journey to Tanzania

      Giana Nicole Davlantes | Education
    • How therapy helps uncover hidden patterns that shape our lives [PODCAST]

      The Podcast by KevinMD | Podcast
    • Focal therapy for prostate cancer: a new option

      Louis S. Liou, MD, PhD | Conditions
    • The power of ordinary joy for physician well-being

      Ben Reinking, MD | Physician
    • Reinforcing trust in AI: a critical role for health tech leaders

      Miles Barr | Tech

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Leave a Comment

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...