Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

The risks of publically reported surgical outcomes

Skeptical Scalpel, MD
Conditions
June 27, 2018
Share
Tweet
Share

“Some data is better than no data at all.” Do you believe that?

I heard it frequently when the infamous ProPublica’s Surgeon Scorecard first appeared three years ago. Back then I blogged about it saying “To me, bad data is worse than no data at all.”

A recent study in BJU International confirmed my thoughts about this type of publicly posted data and identified a previously unreported issue. The paper attempted to determine whether the public was able to accurately interpret statistics used in the Surgeon Scorecard. It turns out they were not very good at it.

Investigators from the department of urology at the University of Minnesota surveyed 343 people who attended the Minnesota State Fair in 2016. Those who took the survey had a median age of 48, were 60% female, 80% white, and 60% college educated. Their median annual income was $26,550 with an interquartile range of $22,882 to $32,587.

The authors showed individuals the figure below on a tablet computer with the accompanying statement “This graph shows the individual surgeons’ complication rates after 28-35 cases. Surgeons A, B and C raw complication rates are A = 1/35 or 2.9%, B = 1/34 or 3.8% and C = 1/28 or 3.6%.”

In case you aren’t sure, understand the complication rates for these three surgeons are not significantly different due to the small numbers of cases and complications.

The most surprising finding of the study was although the surgeons’ complication rates were clearly stated above the figure, just 15.2% of the participants could correctly identify surgeon C’s complication rate. The participants thought the average complication rate for surgeon C was 25% (range 3.6% to 50%). Regarding surgeon B, they were better at estimating the complication rate, but still only 34.9% got it right.

The subjects were asked multiple-choice questions related to the surgeons’ complication rates. When asked to choose a surgeon for a hypothetical procedure, 192 (56%) picked surgeon A, 30 (8.7%) picked B, and 19 (5.5%) selected C; 102 (29.7%) said they didn’t have enough information to decide.

Here’s the new wrinkle on the potential harm of misinterpreting data. The subjects were then told that their insurance would only pay if they used surgeon C, and if they wanted to use one of the other surgeons, they would have to pay out of their own pockets. Almost two-thirds said they would pay an average of $5,754 in order to have their surgery done by surgeon A or B.

Those willing to switch were significantly poorer, had a significantly higher incidence of a history of cancer, and misinterpreted the complication rates significantly more often.

What this means is that the people who could least afford to switch surgeons were the most likely to do so.

Bottom line: People may misinterpret published data on surgical complication rates which could result in financial harm to them.

“Skeptical Scalpel” is a surgeon who blogs at his self-titled site, Skeptical Scalpel.  

ADVERTISEMENT

Image credit: Shutterstock.com

Prev

When does a condition become a medical issue?

June 27, 2018 Kevin 10
…
Next

Restricting opioid prescribing: Some error has to be tolerated

June 27, 2018 Kevin 9
…

Tagged as: Public Health & Policy, Surgery

Post navigation

< Previous Post
When does a condition become a medical issue?
Next Post >
Restricting opioid prescribing: Some error has to be tolerated

ADVERTISEMENT

More by Skeptical Scalpel, MD

  • The hospital CEO who made a surgical incision. What happened?

    Skeptical Scalpel, MD
  • Medical error is not the third leading cause of death

    Skeptical Scalpel, MD
  • Should speed-eating contests be banned?

    Skeptical Scalpel, MD

Related Posts

  • CMS risks ACO success by forcing move to another track

    Manish Naik, MD
  • The promise of in silico drug development to improve patient outcomes

    Tanja Dowe
  • Have you been reported under the Sunshine Act?

    Another Second Opinion, MD
  • Many medical marijuana program websites are silent about possible risks

    Erik Messamore, MD, PhD
  • Adapting medical safety standards to enhance police outcomes

    Richard Plotzker, MD
  • Ownership of outcomes: Reuniting power and responsibility

    Amelia L. Bueche, DO

More in Conditions

  • Why psychotherapy works and why psychotherapy fails

    Peggy A. Rothbaum, PhD
  • How oral health silently affects your heart, brain, and body

    Charles Reinertsen, DMD
  • How President Biden’s cognitive health shapes political and legal trust

    Muhamad Aly Rifai, MD
  • The emotional first responders of aesthetic medicine

    Sarah White, APRN
  • Why testosterone matters more than you think in women’s health

    Andrea Caamano, MD
  • How veteran health care is being transformed by tech and teamwork

    Deborah Lafer Scher
  • Most Popular

  • Past Week

    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
    • The hidden health risks in the One Big Beautiful Bill Act

      Trevor Lyford, MPH | Policy
    • How New Mexico became a malpractice lawsuit hotspot

      Patrick Hudson, MD | Physician
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy
    • Why health care leaders fail at execution—and how to fix it

      Dave Cummings, RN | Policy
    • How digital tools are reshaping the doctor-patient relationship

      Vineet Vishwanath | Tech
  • Past 6 Months

    • Why are medical students turning away from primary care? [PODCAST]

      The Podcast by KevinMD | Podcast
    • What the world must learn from the life and death of Hind Rajab

      Saba Qaiser, RN | Conditions
    • Why “do no harm” might be harming modern medicine

      Sabooh S. Mubbashar, MD | Physician
    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
    • Here’s what providers really need in a modern EHR

      Laura Kohlhagen, MD, MBA | Tech
    • The hidden health risks in the One Big Beautiful Bill Act

      Trevor Lyford, MPH | Policy
  • Recent Posts

    • How regulatory overreach is destroying innovation in U.S. health care

      Kayvan Haddadan, MD | Physician
    • Why the U.S. mental health care system is failing and how to fix it [PODCAST]

      The Podcast by KevinMD | Podcast
    • The unseen cost of detachment in radiology

      Dr. Yesu Raju | Physician
    • I thought success was a destination. Then I became a doctor.

      Ryan Nadelson, MD | Physician
    • Why psychotherapy works and why psychotherapy fails

      Peggy A. Rothbaum, PhD | Conditions
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

View 7 Comments >

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

  • Most Popular

  • Past Week

    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
    • The hidden health risks in the One Big Beautiful Bill Act

      Trevor Lyford, MPH | Policy
    • How New Mexico became a malpractice lawsuit hotspot

      Patrick Hudson, MD | Physician
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy
    • Why health care leaders fail at execution—and how to fix it

      Dave Cummings, RN | Policy
    • How digital tools are reshaping the doctor-patient relationship

      Vineet Vishwanath | Tech
  • Past 6 Months

    • Why are medical students turning away from primary care? [PODCAST]

      The Podcast by KevinMD | Podcast
    • What the world must learn from the life and death of Hind Rajab

      Saba Qaiser, RN | Conditions
    • Why “do no harm” might be harming modern medicine

      Sabooh S. Mubbashar, MD | Physician
    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
    • Here’s what providers really need in a modern EHR

      Laura Kohlhagen, MD, MBA | Tech
    • The hidden health risks in the One Big Beautiful Bill Act

      Trevor Lyford, MPH | Policy
  • Recent Posts

    • How regulatory overreach is destroying innovation in U.S. health care

      Kayvan Haddadan, MD | Physician
    • Why the U.S. mental health care system is failing and how to fix it [PODCAST]

      The Podcast by KevinMD | Podcast
    • The unseen cost of detachment in radiology

      Dr. Yesu Raju | Physician
    • I thought success was a destination. Then I became a doctor.

      Ryan Nadelson, MD | Physician
    • Why psychotherapy works and why psychotherapy fails

      Peggy A. Rothbaum, PhD | Conditions
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

The risks of publically reported surgical outcomes
7 comments

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...