Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

Why AI in health care needs the same scrutiny as chemotherapy

Rafael Rolon Rivera, MD
Tech
August 25, 2025
Share
Tweet
Share

We’ve all seen the hype.

AI will revolutionize health care. It will cut documentation time. Improve diagnoses. Save lives. Maybe even replace doctors.

But here’s what I know after 11 years as a hospitalist: Hype without evidence is dangerous. And AI—especially in medicine—isn’t just software. It’s treatment.

If we’re going to let AI influence life-or-death decisions, it needs to meet the same standard as any clinical intervention. That means rigorous trials, transparent design, and cultural alignment. Anything less is malpractice.

We’ve been here before. Remember Theranos? A dazzling promise, no peer-reviewed proof, and the medical world’s worst-kept secret. It didn’t just waste money—it risked lives. If we treat AI the same way—rolling out tools without evidence, accountability, or ethics—we’re asking for another disaster.

Clinical AI must be validated like any drug or device. Randomized controlled trials aren’t optional—they’re essential. Dr. David Byrne calls this the “secret sauce” for safe AI implementation, and he’s right. We’d never let a new chemotherapy hit the market based on a good pitch deck and some retrospective data. So why are we doing that with algorithms?

And yet, it’s happening. Tools are being deployed without explainability. Without understanding the data they were trained on. Without knowing how they’ll behave in different populations. That’s not innovation—it’s irresponsibility.

Physicians are not the enemy of progress. But we are skeptics for a reason. Skepticism protects patients. It’s why we double-check vitals, question assumptions, and push back on protocols that don’t feel right. If we’re slow to adopt AI, it’s not because we’re resistant. It’s because we remember what happens when systems overpromise and underdeliver.

That skepticism will only grow if we continue to treat physicians as implementation obstacles instead of partners. If AI is to succeed in health care, it must be built around clinician trust. That starts with education. Our colleagues won’t trust a tool they don’t understand—nor should they.

We need AI literacy woven into training programs, hospital onboarding, and executive discussions. We need frameworks that ensure ethical and clinically sound development—like SPIRIT-AI and CONSORT-AI—baked into deployment plans. And we need every leader to understand that an AI rollout is not just an IT project. It’s a clinical intervention that deserves the same scrutiny, the same rigor, and the same humility.

Just because something’s new doesn’t mean it’s good. In Silicon Valley, speed is a virtue. In medicine, safety is. The tech world tests ideas on users. We test interventions on patients. One misstep in a user interface may frustrate a customer. One misstep in medicine can cost a life.

And here’s the real irony.

Physicians want AI to work. We’re tired of clunky EMRs. We want our notes dictated faster, our patients flagged earlier, our discharges smoother. But what we fear is bad change—change without evidence, implementation without governance, and technology that adds burden instead of removing it.

We cannot afford to spend millions on shiny AI dashboards while our EHRs still frustrate basic care. Or roll out “smart” triage tools while ignoring the bias in their training data. Before we launch AI-powered ambulances, let’s make sure we can trust the software that predicts readmissions.

ADVERTISEMENT

Physicians don’t fear innovation. We fear irresponsibility.

That’s why it’s time to flip the script. AI is not an accessory—it’s becoming part of the care plan. And if we accept that, then it must be evaluated, regulated, and respected the way we evaluate everything else we give to our patients.

We need to start treating AI like chemotherapy.

Not because it’s toxic—but because it’s powerful. Because it requires precision, vigilance, and consent. Because it must be safe before it’s scaled. And because if we get it wrong, the consequences are too great.

AI isn’t the future of health care. It’s the present. But it will only succeed if we build it on the foundation that medicine was always meant to stand on: trust, truth, and evidence.

Rafael Rolon Rivera is an internal medicine physician.

Prev

The humanity we bring: a call to hold space in medicine

August 25, 2025 Kevin 0
…
Next

How peer support can save physician lives [PODCAST]

August 25, 2025 Kevin 0
…

Tagged as: Health IT

Post navigation

< Previous Post
The humanity we bring: a call to hold space in medicine
Next Post >
How peer support can save physician lives [PODCAST]

ADVERTISEMENT

More by Rafael Rolon Rivera, MD

  • Why trust and simplicity matter more than buzzwords in hospital AI

    Rafael Rolon Rivera, MD
  • Why AI must support, not replace, human intuition in health care

    Rafael Rolon Rivera, MD

Related Posts

  • Why the health care industry must prioritize health equity

    George T. Mathew, MD, MBA
  • Bridging the rural surgical care gap with rotating health care teams

    Ankit Jain
  • What happened to real care in health care?

    Christopher H. Foster, PhD, MPA
  • To “fix” health care delivery, turn to a value-based health care system

    David Bernstein, MD, MBA
  • Health care’s hidden problem: hospital primary care losses

    Christopher Habig, MBA
  • Melting the iron triangle: Prioritizing health equity in dynamic, innovative health care landscapes

    Nina Cloven, MHA

More in Tech

  • Innovation in medicine: 6 strategies for docs

    Jalene Jacob, MD, MBA
  • AI in medical imaging: When algorithms block the view

    Gerald Kuo
  • Physicians must lead the vetting of AI

    Saurabh Gupta, MD
  • Why Medicare must embrace AI support

    Ronke Lawal
  • Modernizing health care with AI and workflow

    Christina Johns, MD
  • How to adopt AI in health care responsibly

    Dave Wessinger
  • Most Popular

  • Past Week

    • Direct primary care in low-income markets

      Dana Y. Lujan, MBA | Policy
    • Female athlete urine leakage: A urologist explains

      Martina Ambardjieva, MD, PhD | Conditions
    • AI in medical imaging: When algorithms block the view

      Gerald Kuo | Tech
    • Are you neurodivergent or just bored?

      Martha Rosenberg | Meds
    • The danger of dismantling DEI in medicine

      Jacquelyne Gaddy, MD | Physician
    • Why the 4 a.m. wake-up call isn’t for everyone

      Laura Suttin, MD, MBA | Physician
  • Past 6 Months

    • Why you should get your Lp(a) tested

      Monzur Morshed, MD and Kaysan Morshed | Conditions
    • Rebuilding the backbone of health care [PODCAST]

      The Podcast by KevinMD | Podcast
    • The dismantling of public health infrastructure

      Ronald L. Lindsay, MD | Physician
    • The flaw in the ACA’s physician ownership ban

      Luis Tumialán, MD | Policy
    • Systematic neglect of mental health

      Ronke Lawal | Tech
    • Silicon Valley’s primary care doctor shortage

      George F. Smith, MD | Physician
  • Recent Posts

    • Transforming patient fear into understanding through clear communication [PODCAST]

      The Podcast by KevinMD | Podcast
    • How movement improves pelvic floor function

      Martina Ambardjieva, MD, PhD | Conditions
    • How immigrant physicians solved a U.S. crisis

      Eram Alam, PhD | Conditions
    • Pediatric leadership silence on FDA ADHD recall

      Ronald L. Lindsay, MD | Conditions
    • How relationships predict physician burnout risk

      Tomi Mitchell, MD | Physician
    • The ethical conflict of the Charlie Gard case

      Timothy Lesaca, MD | Conditions

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

Leave a Comment

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

ADVERTISEMENT

  • Most Popular

  • Past Week

    • Direct primary care in low-income markets

      Dana Y. Lujan, MBA | Policy
    • Female athlete urine leakage: A urologist explains

      Martina Ambardjieva, MD, PhD | Conditions
    • AI in medical imaging: When algorithms block the view

      Gerald Kuo | Tech
    • Are you neurodivergent or just bored?

      Martha Rosenberg | Meds
    • The danger of dismantling DEI in medicine

      Jacquelyne Gaddy, MD | Physician
    • Why the 4 a.m. wake-up call isn’t for everyone

      Laura Suttin, MD, MBA | Physician
  • Past 6 Months

    • Why you should get your Lp(a) tested

      Monzur Morshed, MD and Kaysan Morshed | Conditions
    • Rebuilding the backbone of health care [PODCAST]

      The Podcast by KevinMD | Podcast
    • The dismantling of public health infrastructure

      Ronald L. Lindsay, MD | Physician
    • The flaw in the ACA’s physician ownership ban

      Luis Tumialán, MD | Policy
    • Systematic neglect of mental health

      Ronke Lawal | Tech
    • Silicon Valley’s primary care doctor shortage

      George F. Smith, MD | Physician
  • Recent Posts

    • Transforming patient fear into understanding through clear communication [PODCAST]

      The Podcast by KevinMD | Podcast
    • How movement improves pelvic floor function

      Martina Ambardjieva, MD, PhD | Conditions
    • How immigrant physicians solved a U.S. crisis

      Eram Alam, PhD | Conditions
    • Pediatric leadership silence on FDA ADHD recall

      Ronald L. Lindsay, MD | Conditions
    • How relationships predict physician burnout risk

      Tomi Mitchell, MD | Physician
    • The ethical conflict of the Charlie Gard case

      Timothy Lesaca, MD | Conditions

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Leave a Comment

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...