Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

The filtering of medical evidence has clearly failed

Ryan Radecki, MD
Physician
March 23, 2013
Share
Tweet
Share

Let me tell you about this fabulous new test – it’s far better than the old tests, I’ve got a decade’s worth of research publications to show you, plus it’s a floor wax and a dessert topping.

Who am I?  Why, I’m simply an academic clinician, advocating for this test because it’s the next great thing to help us tailor treatments to patients.  Does it matter that I’m on the unofficial payroll of the manufacturer of the test equipment?

That is the question, sadly, physicians and policy-makers are asked to make with recurring regularity when trying to translate clinical research to patient care.  To make these choices, we rely on layers of experts and statisticians to do the heavy lifting in the review process.  This starts at the initial process of institutional review, filters up through pilot studies, then small publications, and finally, systematic reviews and publications in the most prominent medical journals.  By the time the state of the art reaches these most prominent journals, it ought to be possible that we can put unfailing faith in its veracity.

This is decidedly not the case.  A couple weeks ago the Journal of the American Medical Association published a “Clinical Evidence Synopsis” covering the use of procalcitonin measurements to promote antibiotic stewardship.  This synopsis strongly endorses the use of procalcitonin assays to guide antibiotic prescribing in pneumonia and summarizes 14 positive studies in support of its recommendations.  I hardly count myself an expert in this area, but I recalled at the minimum a couple recent studies showing procalcitonin-guided strategies were ineffective or harmful.

To cut a long story short, the JAMA article is written by three physicians who have financial conflicts of interest with the manufacturer of the procalcitonin assay.  The evidence they summarize is a Cochrane Review that counts themselves and a total of eight authors who declare COI with the manufacturer.  On top of that, 11 of the 14 positive studies included in the Cochrane Review are published by authors who declare COI with the manufacturer.  I reviewed each of these articles, and they count amongst themselves trials performed in heterogenous settings with small sample sizes (as few as 8!), high risks of bias, and significant limitations.

The filtering of medical evidence has clearly failed on multiple levels to reach this point.  Practicing clinicians have neither the free time to comb through the original articles, nor likely the institutional access that allows them to even download them without incurring substantial costs.  They are dependent on prominent journals to be vigilant against distortion in a fashion most would find excessive.  JAMA, with a qualified circulation in excess of 300,000 and one of the highest impact factors in medicine, should be one of those gatekeepers.

We need to expect and demand better of these respected institutions to better reflect their mission “to promote the science and art of medicine and the betterment of the public health.”

Ryan Radecki is an emergency physician and AHRQ Patient Safety and Quality Fellow.  He blogs at Emergency Medicine Literature of Note and can be found on Twitter @emlitofnote.

Prev

Why digital health tools need to be rated

March 23, 2013 Kevin 2
…
Next

Why is cost so obscure in healthcare?

March 23, 2013 Kevin 23
…

Tagged as: Emergency Medicine, Infectious Disease

Post navigation

< Previous Post
Why digital health tools need to be rated
Next Post >
Why is cost so obscure in healthcare?

ADVERTISEMENT

ADVERTISEMENT

ADVERTISEMENT

More in Physician

  • The invisible weight carried by Black female physicians

    Trisza Leann Ray, DO
  • A female doctor’s day: exhaustion, sacrifice, and a single moment of joy

    Dr. Damane Zehra
  • The hidden cost of malpractice: Why doctors are losing control

    Howard Smith, MD
  • How scales of justice saved a doctor-patient relationship

    Neil Baum, MD
  • Rediscovering the soul of medicine in the quiet of a Sunday morning

    Syed Ahmad Moosa, MD
  • The broken health care system doesn’t have to break you

    Jessie Mahoney, MD
  • Most Popular

  • Past Week

    • What’s driving medical students away from primary care?

      ​​Vineeth Amba, MPH, Archita Goyal, and Wayne Altman, MD | Education
    • The broken health care system doesn’t have to break you

      Jessie Mahoney, MD | Physician
    • How scales of justice saved a doctor-patient relationship

      Neil Baum, MD | Physician
    • Make cognitive testing as routine as a blood pressure check

      Joshua Baker and James Jackson, PsyD | Conditions
    • The dreaded question: Do you have boys or girls?

      Pamela Adelstein, MD | Physician
    • The hidden cost of delaying back surgery

      Gbolahan Okubadejo, MD | Conditions
  • Past 6 Months

    • What’s driving medical students away from primary care?

      ​​Vineeth Amba, MPH, Archita Goyal, and Wayne Altman, MD | Education
    • Internal Medicine 2025: inspiration at the annual meeting

      American College of Physicians | Physician
    • What happened to real care in health care?

      Christopher H. Foster, PhD, MPA | Policy
    • Residency as rehearsal: the new pediatric hospitalist fellowship requirement scam

      Anonymous | Physician
    • Are quotas a solution to physician shortages?

      Jacob Murphy | Education
    • A faster path to becoming a doctor is possible—here’s how

      Ankit Jain | Education
  • Recent Posts

    • “Think twice, heal once”: Why medical decision-making needs a second opinion from your slower brain (and AI)

      Harvey Castro, MD, MBA | Tech
    • The invisible weight carried by Black female physicians

      Trisza Leann Ray, DO | Physician
    • A female doctor’s day: exhaustion, sacrifice, and a single moment of joy

      Dr. Damane Zehra | Physician
    • Addressing America’s reliance on psychotropic medication [PODCAST]

      The Podcast by KevinMD | Podcast
    • The hidden cost of malpractice: Why doctors are losing control

      Howard Smith, MD | Physician
    • How scales of justice saved a doctor-patient relationship

      Neil Baum, MD | Physician

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

View 7 Comments >

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

ADVERTISEMENT

ADVERTISEMENT

ADVERTISEMENT

  • Most Popular

  • Past Week

    • What’s driving medical students away from primary care?

      ​​Vineeth Amba, MPH, Archita Goyal, and Wayne Altman, MD | Education
    • The broken health care system doesn’t have to break you

      Jessie Mahoney, MD | Physician
    • How scales of justice saved a doctor-patient relationship

      Neil Baum, MD | Physician
    • Make cognitive testing as routine as a blood pressure check

      Joshua Baker and James Jackson, PsyD | Conditions
    • The dreaded question: Do you have boys or girls?

      Pamela Adelstein, MD | Physician
    • The hidden cost of delaying back surgery

      Gbolahan Okubadejo, MD | Conditions
  • Past 6 Months

    • What’s driving medical students away from primary care?

      ​​Vineeth Amba, MPH, Archita Goyal, and Wayne Altman, MD | Education
    • Internal Medicine 2025: inspiration at the annual meeting

      American College of Physicians | Physician
    • What happened to real care in health care?

      Christopher H. Foster, PhD, MPA | Policy
    • Residency as rehearsal: the new pediatric hospitalist fellowship requirement scam

      Anonymous | Physician
    • Are quotas a solution to physician shortages?

      Jacob Murphy | Education
    • A faster path to becoming a doctor is possible—here’s how

      Ankit Jain | Education
  • Recent Posts

    • “Think twice, heal once”: Why medical decision-making needs a second opinion from your slower brain (and AI)

      Harvey Castro, MD, MBA | Tech
    • The invisible weight carried by Black female physicians

      Trisza Leann Ray, DO | Physician
    • A female doctor’s day: exhaustion, sacrifice, and a single moment of joy

      Dr. Damane Zehra | Physician
    • Addressing America’s reliance on psychotropic medication [PODCAST]

      The Podcast by KevinMD | Podcast
    • The hidden cost of malpractice: Why doctors are losing control

      Howard Smith, MD | Physician
    • How scales of justice saved a doctor-patient relationship

      Neil Baum, MD | Physician

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

The filtering of medical evidence has clearly failed
7 comments

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...