Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

Why AI in health care needs the same scrutiny as chemotherapy

Rafael Rolon Rivera, MD
Tech
August 25, 2025
Share
Tweet
Share

We’ve all seen the hype.

AI will revolutionize health care. It will cut documentation time. Improve diagnoses. Save lives. Maybe even replace doctors.

But here’s what I know after 11 years as a hospitalist: Hype without evidence is dangerous. And AI—especially in medicine—isn’t just software. It’s treatment.

If we’re going to let AI influence life-or-death decisions, it needs to meet the same standard as any clinical intervention. That means rigorous trials, transparent design, and cultural alignment. Anything less is malpractice.

We’ve been here before. Remember Theranos? A dazzling promise, no peer-reviewed proof, and the medical world’s worst-kept secret. It didn’t just waste money—it risked lives. If we treat AI the same way—rolling out tools without evidence, accountability, or ethics—we’re asking for another disaster.

Clinical AI must be validated like any drug or device. Randomized controlled trials aren’t optional—they’re essential. Dr. David Byrne calls this the “secret sauce” for safe AI implementation, and he’s right. We’d never let a new chemotherapy hit the market based on a good pitch deck and some retrospective data. So why are we doing that with algorithms?

And yet, it’s happening. Tools are being deployed without explainability. Without understanding the data they were trained on. Without knowing how they’ll behave in different populations. That’s not innovation—it’s irresponsibility.

Physicians are not the enemy of progress. But we are skeptics for a reason. Skepticism protects patients. It’s why we double-check vitals, question assumptions, and push back on protocols that don’t feel right. If we’re slow to adopt AI, it’s not because we’re resistant. It’s because we remember what happens when systems overpromise and underdeliver.

That skepticism will only grow if we continue to treat physicians as implementation obstacles instead of partners. If AI is to succeed in health care, it must be built around clinician trust. That starts with education. Our colleagues won’t trust a tool they don’t understand—nor should they.

We need AI literacy woven into training programs, hospital onboarding, and executive discussions. We need frameworks that ensure ethical and clinically sound development—like SPIRIT-AI and CONSORT-AI—baked into deployment plans. And we need every leader to understand that an AI rollout is not just an IT project. It’s a clinical intervention that deserves the same scrutiny, the same rigor, and the same humility.

Just because something’s new doesn’t mean it’s good. In Silicon Valley, speed is a virtue. In medicine, safety is. The tech world tests ideas on users. We test interventions on patients. One misstep in a user interface may frustrate a customer. One misstep in medicine can cost a life.

And here’s the real irony.

Physicians want AI to work. We’re tired of clunky EMRs. We want our notes dictated faster, our patients flagged earlier, our discharges smoother. But what we fear is bad change—change without evidence, implementation without governance, and technology that adds burden instead of removing it.

We cannot afford to spend millions on shiny AI dashboards while our EHRs still frustrate basic care. Or roll out “smart” triage tools while ignoring the bias in their training data. Before we launch AI-powered ambulances, let’s make sure we can trust the software that predicts readmissions.

ADVERTISEMENT

Physicians don’t fear innovation. We fear irresponsibility.

That’s why it’s time to flip the script. AI is not an accessory—it’s becoming part of the care plan. And if we accept that, then it must be evaluated, regulated, and respected the way we evaluate everything else we give to our patients.

We need to start treating AI like chemotherapy.

Not because it’s toxic—but because it’s powerful. Because it requires precision, vigilance, and consent. Because it must be safe before it’s scaled. And because if we get it wrong, the consequences are too great.

AI isn’t the future of health care. It’s the present. But it will only succeed if we build it on the foundation that medicine was always meant to stand on: trust, truth, and evidence.

Rafael Rolon Rivera is an internal medicine physician.

Prev

The humanity we bring: a call to hold space in medicine

August 25, 2025 Kevin 0
…
Next

How peer support can save physician lives [PODCAST]

August 25, 2025 Kevin 0
…

Tagged as: Health IT

Post navigation

< Previous Post
The humanity we bring: a call to hold space in medicine
Next Post >
How peer support can save physician lives [PODCAST]

ADVERTISEMENT

More by Rafael Rolon Rivera, MD

  • Why trust and simplicity matter more than buzzwords in hospital AI

    Rafael Rolon Rivera, MD
  • Why AI must support, not replace, human intuition in health care

    Rafael Rolon Rivera, MD

Related Posts

  • Why the health care industry must prioritize health equity

    George T. Mathew, MD, MBA
  • Bridging the rural surgical care gap with rotating health care teams

    Ankit Jain
  • What happened to real care in health care?

    Christopher H. Foster, PhD, MPA
  • To “fix” health care delivery, turn to a value-based health care system

    David Bernstein, MD, MBA
  • Health care’s hidden problem: hospital primary care losses

    Christopher Habig, MBA
  • Melting the iron triangle: Prioritizing health equity in dynamic, innovative health care landscapes

    Nina Cloven, MHA

More in Tech

  • ChatGPT Health in hospitals: 5 essential safety protocols

    Harvey Castro, MD, MBA
  • AI in medicine risks: the new Oracle of Delphi?

    Harvey Castro, MD, MBA
  • Agentic AI in medicine: Moving beyond ChatGPT

    Harvey Castro, MD, MBA
  • The loss of storytelling with ambient AI systems

    Alexandria Phan, MD
  • The consequences of adopting AI in medicine

    Jordan Liz, PhD
  • Why AI in medicine elevates humanity instead of replacing it

    Tod Stillson, MD
  • Most Popular

  • Past Week

    • Whole-body MRI screening: political privilege or future of care?

      Michael Brant-Zawadzki, MD | Physician
    • Physician attrition rates rise: the hidden crisis in health care

      Arthur Lazarus, MD, MBA | Physician
    • How frivolous lawsuits drive up health care costs

      Howard Smith, MD | Physician
    • The physical exam in the AI era

      Jason Ryan, MD | Physician
    • Concierge medicine access: Is it really the problem?

      Dana Y. Lujan, MBA | Conditions
    • ChatGPT Health in hospitals: 5 essential safety protocols

      Harvey Castro, MD, MBA | Tech
  • Past 6 Months

    • Why patient trust in physicians is declining

      Mansi Kotwal, MD, MPH | Physician
    • Is primary care becoming a triage station?

      J. Leonard Lichtenfeld, MD | Physician
    • The blind men and the elephant: a parable for modern pain management

      Richard A. Lawhern, PhD | Conditions
    • Psychiatrists are physicians: a key distinction

      Farid Sabet-Sharghi, MD | Physician
    • The loss of community pharmacy expertise

      Muhammad Abdullah Khan | Conditions
    • Catching type 1 diabetes before it becomes life-threatening [PODCAST]

      The Podcast by KevinMD | Podcast
  • Recent Posts

    • ChatGPT Health in hospitals: 5 essential safety protocols

      Harvey Castro, MD, MBA | Tech
    • Why fear-based approaches fail in chronic illness care

      Bridgette Johnson, PhD, RN | Conditions
    • Medical brain drain leaves vulnerable communities without life-saving care [PODCAST]

      The Podcast by KevinMD | Podcast
    • Why a nice surgeon might actually be a better surgeon

      Sierra Grasso, MD | Physician
    • Did ABIM MOC reform actually fix the problem for physicians?

      Brian Hudes, MD | Physician
    • Scrotal pain in young men: When to seek urgent care

      Martina Ambardjieva, MD, PhD | Conditions

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

Leave a Comment

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

ADVERTISEMENT

  • Most Popular

  • Past Week

    • Whole-body MRI screening: political privilege or future of care?

      Michael Brant-Zawadzki, MD | Physician
    • Physician attrition rates rise: the hidden crisis in health care

      Arthur Lazarus, MD, MBA | Physician
    • How frivolous lawsuits drive up health care costs

      Howard Smith, MD | Physician
    • The physical exam in the AI era

      Jason Ryan, MD | Physician
    • Concierge medicine access: Is it really the problem?

      Dana Y. Lujan, MBA | Conditions
    • ChatGPT Health in hospitals: 5 essential safety protocols

      Harvey Castro, MD, MBA | Tech
  • Past 6 Months

    • Why patient trust in physicians is declining

      Mansi Kotwal, MD, MPH | Physician
    • Is primary care becoming a triage station?

      J. Leonard Lichtenfeld, MD | Physician
    • The blind men and the elephant: a parable for modern pain management

      Richard A. Lawhern, PhD | Conditions
    • Psychiatrists are physicians: a key distinction

      Farid Sabet-Sharghi, MD | Physician
    • The loss of community pharmacy expertise

      Muhammad Abdullah Khan | Conditions
    • Catching type 1 diabetes before it becomes life-threatening [PODCAST]

      The Podcast by KevinMD | Podcast
  • Recent Posts

    • ChatGPT Health in hospitals: 5 essential safety protocols

      Harvey Castro, MD, MBA | Tech
    • Why fear-based approaches fail in chronic illness care

      Bridgette Johnson, PhD, RN | Conditions
    • Medical brain drain leaves vulnerable communities without life-saving care [PODCAST]

      The Podcast by KevinMD | Podcast
    • Why a nice surgeon might actually be a better surgeon

      Sierra Grasso, MD | Physician
    • Did ABIM MOC reform actually fix the problem for physicians?

      Brian Hudes, MD | Physician
    • Scrotal pain in young men: When to seek urgent care

      Martina Ambardjieva, MD, PhD | Conditions

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Leave a Comment

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...