Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

Bias and error are rampant in medical literature

Anonymous
Physician
March 18, 2012
Share
Tweet
Share

A heretic essay in JAMA by Vinay Prasad (Northwestern of Chicago), Adam Cifu (U. of Chicago) and John Ioannidis (Stanford) should be required reading for every medical student and resident and to pass any board certification exam in any specialty … in my humble opinion.

John Ioannidis became one of my personal heroes with the publication of his great paper in PLoS Medicine, “Why Most Published Research Findings Are False,” and its follow-up Atlantic magazine profile (“Lies, Damn Lies, and Medical Science“). Rather than being nihilistic, Ioannidis’s essay is an elegant statistical proof that makes the simple point that bias and error are inevitable and rampant in the published body of medical literature.

Here they put away their statistical software and ask us, doctor-to-doctor, to simply consider “When To Abandon Ship,” i.e., to identify and permanently shelve those medical practices that though familiar, are in reality failed or useless to patients (but not to doctors’, hospitals’, and industry’s balance sheets). True to their previous form, they eschew formal “journal speak” and use their same refreshingly unadorned and fearless prose:

How many established standards of medical care are wrong? It is not known. Medical practice has evolved out of centuries of theorizing, personal experiences, bits of evidence, expert consensus, and diverse conflicts and biases. Rigorous questioning of long-established practices is difficult. There are thousands of clinical trials, but most deal with trivialities or efforts to buttress the sales of specific products. Given this conundrum, it is possible that some entire medical subspecialties are based on little evidence. Their disappearance probably would not harm patients and might help salvage derailed health budgets. However, it is unlikely that specialists would support trials testing practices that constitute their main source of income. Instead, the research community performs studies of modest incremental value without even knowing whether the basic standards of care are appropriate.

They use examples of stenting for stable coronary artery disease (which comprised 85% of stenting procedures until the aptly-named COURAGE trial showed it didn’t help), vertebroplasty, and estrogen replacement therapy, among others. A highly-cited previous article by these authors suggested that when follow-up randomized trials are conducted on a major accepted therapy, they refute standard practice about half the time.

Authors call for greater barriers to the implementation of new devices, drugs, and interventional procedures and the requirement of large randomized trials to establish benefits before the wide implementation of new practices. (Industry-supported advocacy groups figured out long ago how to counter these efforts, though: 1. Organize patients with the condition. 2. Make the public relations case to politicians and the media that regulation stifles innovation that could help people suffering. Voila! Restrictions on funding for unproven medical technologies disappear.)

It’s a trip through the looking glass of our profession’s solipsism: the endemic self-interest, self-protection, and self-promotion that has guided the centuries-long evolution of medical practice and pervades it today — including all our professional societies, high-minded journals, jealously guarded reputations, and industry relationships. None of us wants outsiders (other specialists, policymakers, patients) to look too closely or skeptically at what we do — and the essential prerequisite to preventing that is to not look too closely ourselves. If something we’re used to doing doesn’t seem to work well, or we just don’t know, there’s always tradition, habit, or patient expectations to fall back on.

But are these barriers to self-examination just rationalizations, proxies for what is, in reality, a desire to maintain the veil of secrecy that we know will help preserve our incomes, professional turf, and what remains of our respect from the public? The final irony is that the more energetically the veil is maintained, the less respect we earn or deserve as society’s last trusted protectors of our patients’ interests in health.

The author is an anonymous physician.

Prev

Unregulated supplements are a tragedy in waiting

March 17, 2012 Kevin 9
…
Next

Hearing loss affects more people than you think

March 18, 2012 Kevin 6
…

Tagged as: Specialist

Post navigation

< Previous Post
Unregulated supplements are a tragedy in waiting
Next Post >
Hearing loss affects more people than you think

ADVERTISEMENT

ADVERTISEMENT

ADVERTISEMENT

More by Anonymous

  • Why young doctors in South Korea feel broken before they even begin

    Anonymous
  • Do Jewish students face rising bias in holistic admissions?

    Anonymous
  • Medical students in Korea face expulsion for speaking out

    Anonymous

Related Posts

  • Digital advances in the medical aid in dying movement

    Jennifer Lynn
  • Medical error is not the third leading cause of death

    Skeptical Scalpel, MD
  • Teaching medical professionalism through literature

    Susan Stagno, MD and Michael Blackie, PhD
  • A medical student’s story of racism and bias

    Akosua Y. Oppong
  • The dark side of negativity bias in medical school

    Jay Thetford
  • How the COVID-19 pandemic highlights the need for social media training in medical education 

    Oscar Chen, Sera Choi, and Clara Seong

More in Physician

  • When a doctor becomes the narrator of a patient’s final chapter

    Ryan McCarthy, MD
  • Gaslighting and professional licensing: a call for reform

    Donald J. Murphy, MD
  • When service doesn’t mean another certification

    Maureen Gibbons, MD
  • Why so many physicians struggle to feel proud—even when they should

    Jessie Mahoney, MD
  • If I had to choose: Choosing the patient over the protocol

    Patrick Hudson, MD
  • How a TV drama exposed the hidden grief of doctors

    Lauren Weintraub, MD
  • Most Popular

  • Past Week

    • Physician patriots: the forgotten founders who lit the torch of liberty

      Muhamad Aly Rifai, MD | Physician
    • Why medical students are trading empathy for publications

      Vijay Rajput, MD | Education
    • The hidden cost of becoming a doctor: a South Asian perspective

      Momeina Aslam | Education
    • Why fixing health care’s data quality is crucial for AI success [PODCAST]

      Jay Anders, MD | Podcast
    • When a doctor becomes the narrator of a patient’s final chapter

      Ryan McCarthy, MD | Physician
    • When errors of nature are treated as medical negligence

      Howard Smith, MD | Physician
  • Past 6 Months

    • What’s driving medical students away from primary care?

      ​​Vineeth Amba, MPH, Archita Goyal, and Wayne Altman, MD | Education
    • A faster path to becoming a doctor is possible—here’s how

      Ankit Jain | Education
    • How dismantling DEI endangers the future of medical care

      Shashank Madhu and Christian Tallo | Education
    • Make cognitive testing as routine as a blood pressure check

      Joshua Baker and James Jackson, PsyD | Conditions
    • How scales of justice saved a doctor-patient relationship

      Neil Baum, MD | Physician
    • The broken health care system doesn’t have to break you

      Jessie Mahoney, MD | Physician
  • Recent Posts

    • When a doctor becomes the narrator of a patient’s final chapter

      Ryan McCarthy, MD | Physician
    • Why innovation in health care starts with bold thinking

      Miguel Villagra, MD | Tech
    • Navigating fair market value as an independent or locum tenens physician [PODCAST]

      The Podcast by KevinMD | Podcast
    • Gaslighting and professional licensing: a call for reform

      Donald J. Murphy, MD | Physician
    • How self-improving AI systems are redefining intelligence and what it means for health care

      Harvey Castro, MD, MBA | Tech
    • How blockchain could rescue nursing home patients from deadly miscommunication

      Adwait Chafale | Tech

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

View 7 Comments >

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

ADVERTISEMENT

ADVERTISEMENT

ADVERTISEMENT

  • Most Popular

  • Past Week

    • Physician patriots: the forgotten founders who lit the torch of liberty

      Muhamad Aly Rifai, MD | Physician
    • Why medical students are trading empathy for publications

      Vijay Rajput, MD | Education
    • The hidden cost of becoming a doctor: a South Asian perspective

      Momeina Aslam | Education
    • Why fixing health care’s data quality is crucial for AI success [PODCAST]

      Jay Anders, MD | Podcast
    • When a doctor becomes the narrator of a patient’s final chapter

      Ryan McCarthy, MD | Physician
    • When errors of nature are treated as medical negligence

      Howard Smith, MD | Physician
  • Past 6 Months

    • What’s driving medical students away from primary care?

      ​​Vineeth Amba, MPH, Archita Goyal, and Wayne Altman, MD | Education
    • A faster path to becoming a doctor is possible—here’s how

      Ankit Jain | Education
    • How dismantling DEI endangers the future of medical care

      Shashank Madhu and Christian Tallo | Education
    • Make cognitive testing as routine as a blood pressure check

      Joshua Baker and James Jackson, PsyD | Conditions
    • How scales of justice saved a doctor-patient relationship

      Neil Baum, MD | Physician
    • The broken health care system doesn’t have to break you

      Jessie Mahoney, MD | Physician
  • Recent Posts

    • When a doctor becomes the narrator of a patient’s final chapter

      Ryan McCarthy, MD | Physician
    • Why innovation in health care starts with bold thinking

      Miguel Villagra, MD | Tech
    • Navigating fair market value as an independent or locum tenens physician [PODCAST]

      The Podcast by KevinMD | Podcast
    • Gaslighting and professional licensing: a call for reform

      Donald J. Murphy, MD | Physician
    • How self-improving AI systems are redefining intelligence and what it means for health care

      Harvey Castro, MD, MBA | Tech
    • How blockchain could rescue nursing home patients from deadly miscommunication

      Adwait Chafale | Tech

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Bias and error are rampant in medical literature
7 comments

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...