Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

Chance: The difference between an unlucky surgeon and a killer

Skeptical Scalpel, MD
Physician
September 15, 2014
Share
Tweet
Share

Risk-adjusted 30- to 90-day outcome data for selected types of operations done by specific surgeons and hospitals are now being publicly posted online by England’s National Health Service.

According to the site, “Any hospital or consultant [attending surgeon in the UK] identified as an outlier will be investigated and action taken to improve data quality and/or patient care.”

After cardiac surgery outcomes data were made public in New York, some interesting unexpected consequences were noted.

Surgeons and hospitals resorted to gaming the system by declining to operate on patients who were high-risk and tinkering with patient charts to make those they did operate on seem sicker. This can be done by scouring the charts for all co-morbidities and making sure none are overlooked when they are coded. An article from New York Magazine explains it in more detail.

Interpreting outcomes data can be tricky.

In a post three years ago about a report that nine Maryland hospitals had higher-than-average complication rates, I pointed out that whenever you have averages, some hospitals are going to be worse than average unless all hospitals perform exactly the same way or, like medical students, are all above average.

A much more sophisticated way of looking at this subject appeared in a fascinating 2010 BBC News piece by Michael Blastland, who is the Nate Silver of England (or maybe Nate Silver is the Michael Blastland of the U.S.), called “Can chance make you a killer?”

Blastland set up a statistical chance calculator for a hypothetical set of 100 hospitals or 100 surgeons performing 100 operations each. The model assumes that every patient has the same chance of dying and that every surgeon is equally competent. The standard is that a mortality rate 60% worse than the norm set by the government for any hospital or surgeon is not acceptable.

You are assigned one hospital. Using a slider, you may choose an operative mortality rate anywhere from 1% to 15%. After you do this a number of times and recalculate for each mortality rate, you will notice that the number of unacceptably performing hospitals or surgeons changes randomly for each percent mortality and your hospital may appear in the underperforming group strictly by chance alone.

The whole concept is explained in more detail on the site. I encourage you to try it for yourself.

So it may be difficult for the NHS to separate the true outliers from the unlucky surgeons who happened to fall outside the established norms.

“Skeptical Scalpel” is a surgeon blogs at his self-titled site, Skeptical Scalpel.

Prev

Want doctors to be more emotionally available? Stop emasculating them.

September 15, 2014 Kevin 33
…
Next

Alternative medicine: There should only be one standard

September 16, 2014 Kevin 0
…

ADVERTISEMENT

Tagged as: Surgery

Post navigation

< Previous Post
Want doctors to be more emotionally available? Stop emasculating them.
Next Post >
Alternative medicine: There should only be one standard

ADVERTISEMENT

More by Skeptical Scalpel, MD

  • The hospital CEO who made a surgical incision. What happened?

    Skeptical Scalpel, MD
  • Medical error is not the third leading cause of death

    Skeptical Scalpel, MD
  • Should speed-eating contests be banned?

    Skeptical Scalpel, MD

More in Physician

  • How subjective likability practices undermine Canada’s health workforce recruitment and retention

    Olumuyiwa Bamgbade, MD
  • Why judgment is hurting doctors—and how mindfulness can heal

    Jessie Mahoney, MD
  • Why evidence-based management may be an effective strategy for stronger health care leadership and equity

    Olumuyiwa Bamgbade, MD
  • The gift we keep giving: How medicine demands everything—even our holidays

    Tomi Mitchell, MD
  • From burnout to balance: a neurosurgeon’s bold career redesign

    Jessie Mahoney, MD
  • Why working in Hawai’i health care isn’t all paradise

    Clayton Foster, MD
  • Most Popular

  • Past Week

    • The hidden health risks in the One Big Beautiful Bill Act

      Trevor Lyford, MPH | Policy
    • How New Mexico became a malpractice lawsuit hotspot

      Patrick Hudson, MD | Physician
    • Why doctors are reclaiming control from burnout culture

      Maureen Gibbons, MD | Physician
    • Why health care leaders fail at execution—and how to fix it

      Dave Cummings, RN | Policy
    • How digital tools are reshaping the doctor-patient relationship

      Vineet Vishwanath | Tech
    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
  • Past 6 Months

    • Why are medical students turning away from primary care? [PODCAST]

      The Podcast by KevinMD | Podcast
    • What the world must learn from the life and death of Hind Rajab

      Saba Qaiser, RN | Conditions
    • Why “do no harm” might be harming modern medicine

      Sabooh S. Mubbashar, MD | Physician
    • Here’s what providers really need in a modern EHR

      Laura Kohlhagen, MD, MBA | Tech
    • The hidden health risks in the One Big Beautiful Bill Act

      Trevor Lyford, MPH | Policy
    • Why Medicaid cuts should alarm every doctor

      Ilan Shapiro, MD | Policy
  • Recent Posts

    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
    • Decoding your medical bill: What those charges really mean

      Cheryl Spang | Finance
    • The emotional first responders of aesthetic medicine

      Sarah White, APRN | Conditions
    • Why testosterone matters more than you think in women’s health

      Andrea Caamano, MD | Conditions
    • A mind to guide the machine: Why physicians must help shape artificial intelligence in medicine

      Shanice Spence-Miller, MD | Tech
    • How subjective likability practices undermine Canada’s health workforce recruitment and retention

      Olumuyiwa Bamgbade, MD | Physician

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

View 5 Comments >

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

  • Most Popular

  • Past Week

    • The hidden health risks in the One Big Beautiful Bill Act

      Trevor Lyford, MPH | Policy
    • How New Mexico became a malpractice lawsuit hotspot

      Patrick Hudson, MD | Physician
    • Why doctors are reclaiming control from burnout culture

      Maureen Gibbons, MD | Physician
    • Why health care leaders fail at execution—and how to fix it

      Dave Cummings, RN | Policy
    • How digital tools are reshaping the doctor-patient relationship

      Vineet Vishwanath | Tech
    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
  • Past 6 Months

    • Why are medical students turning away from primary care? [PODCAST]

      The Podcast by KevinMD | Podcast
    • What the world must learn from the life and death of Hind Rajab

      Saba Qaiser, RN | Conditions
    • Why “do no harm” might be harming modern medicine

      Sabooh S. Mubbashar, MD | Physician
    • Here’s what providers really need in a modern EHR

      Laura Kohlhagen, MD, MBA | Tech
    • The hidden health risks in the One Big Beautiful Bill Act

      Trevor Lyford, MPH | Policy
    • Why Medicaid cuts should alarm every doctor

      Ilan Shapiro, MD | Policy
  • Recent Posts

    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
    • Decoding your medical bill: What those charges really mean

      Cheryl Spang | Finance
    • The emotional first responders of aesthetic medicine

      Sarah White, APRN | Conditions
    • Why testosterone matters more than you think in women’s health

      Andrea Caamano, MD | Conditions
    • A mind to guide the machine: Why physicians must help shape artificial intelligence in medicine

      Shanice Spence-Miller, MD | Tech
    • How subjective likability practices undermine Canada’s health workforce recruitment and retention

      Olumuyiwa Bamgbade, MD | Physician

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Chance: The difference between an unlucky surgeon and a killer
5 comments

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...