Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

Chance: The difference between an unlucky surgeon and a killer

Skeptical Scalpel, MD
Physician
September 15, 2014
Share
Tweet
Share

Risk-adjusted 30- to 90-day outcome data for selected types of operations done by specific surgeons and hospitals are now being publicly posted online by England’s National Health Service.

According to the site, “Any hospital or consultant [attending surgeon in the UK] identified as an outlier will be investigated and action taken to improve data quality and/or patient care.”

After cardiac surgery outcomes data were made public in New York, some interesting unexpected consequences were noted.

Surgeons and hospitals resorted to gaming the system by declining to operate on patients who were high-risk and tinkering with patient charts to make those they did operate on seem sicker. This can be done by scouring the charts for all co-morbidities and making sure none are overlooked when they are coded. An article from New York Magazine explains it in more detail.

Interpreting outcomes data can be tricky.

In a post three years ago about a report that nine Maryland hospitals had higher-than-average complication rates, I pointed out that whenever you have averages, some hospitals are going to be worse than average unless all hospitals perform exactly the same way or, like medical students, are all above average.

A much more sophisticated way of looking at this subject appeared in a fascinating 2010 BBC News piece by Michael Blastland, who is the Nate Silver of England (or maybe Nate Silver is the Michael Blastland of the U.S.), called “Can chance make you a killer?”

Blastland set up a statistical chance calculator for a hypothetical set of 100 hospitals or 100 surgeons performing 100 operations each. The model assumes that every patient has the same chance of dying and that every surgeon is equally competent. The standard is that a mortality rate 60% worse than the norm set by the government for any hospital or surgeon is not acceptable.

You are assigned one hospital. Using a slider, you may choose an operative mortality rate anywhere from 1% to 15%. After you do this a number of times and recalculate for each mortality rate, you will notice that the number of unacceptably performing hospitals or surgeons changes randomly for each percent mortality and your hospital may appear in the underperforming group strictly by chance alone.

The whole concept is explained in more detail on the site. I encourage you to try it for yourself.

So it may be difficult for the NHS to separate the true outliers from the unlucky surgeons who happened to fall outside the established norms.

“Skeptical Scalpel” is a surgeon blogs at his self-titled site, Skeptical Scalpel.

Prev

Want doctors to be more emotionally available? Stop emasculating them.

September 15, 2014 Kevin 33
…
Next

Alternative medicine: There should only be one standard

September 16, 2014 Kevin 0
…

ADVERTISEMENT

Tagged as: Surgery

Post navigation

< Previous Post
Want doctors to be more emotionally available? Stop emasculating them.
Next Post >
Alternative medicine: There should only be one standard

ADVERTISEMENT

More by Skeptical Scalpel, MD

  • The hospital CEO who made a surgical incision. What happened?

    Skeptical Scalpel, MD
  • Medical error is not the third leading cause of death

    Skeptical Scalpel, MD
  • Should speed-eating contests be banned?

    Skeptical Scalpel, MD

More in Physician

  • Complicity vs. protest: a doctor’s choice

    Patrick Hudson, MD
  • When cancer costs too much: Why financial toxicity deserves a place in clinical conversations

    Yousuf Zafar, MD
  • The hidden rewards of a primary care career

    Jerina Gani, MD, MPH
  • Why doctors regret specialty choices in their 30s

    Jeremiah J. Whittington, MD
  • 10 hard truths about practicing medicine they don’t teach in school

    Steven Goldsmith, MD
  • How I learned to love my unique name as a doctor

    Zoran Naumovski, MD
  • Most Popular

  • Past Week

    • Why doctors must fight for a just health care system

      Alankrita Olson, MD, MPH & Ashley Duhon, MD & Toby Terwilliger, MD | Policy
    • The human case for preserving the nipple after mastectomy

      Thomas Amburn, MD | Conditions
    • IMGs are the future of U.S. primary care

      Adam Brandon Bondoc, MD | Physician
    • How transplant recipients can pay it forward through organ donation

      Deepak Gupta, MD | Physician
    • Women physicians: How can they survive and thrive in academic medicine?

      Elina Maymind, MD | Physician
    • Why AI in health care needs stronger testing before clinical use [PODCAST]

      The Podcast by KevinMD | Podcast
  • Past 6 Months

    • Health equity in Inland Southern California requires urgent action

      Vishruth Nagam | Policy
    • How restrictive opioid policies worsen the crisis

      Kayvan Haddadan, MD | Physician
    • Why primary care needs better dermatology training

      Alex Siauw | Conditions
    • Why pain doctors face unfair scrutiny and harsh penalties in California

      Kayvan Haddadan, MD | Physician
    • How hospitals can prepare for CMS’s new patient safety rule

      Kim Adelman, PhD | Conditions
    • Why physician strikes are a form of hospice

      Patrick Hudson, MD | Physician
  • Recent Posts

    • How to transform your mindset by rewiring your brain with positive language [PODCAST]

      The Podcast by KevinMD | Podcast
    • What is a varicocele and how does it affect fertility?

      Martina Ambardjieva, MD, PhD | Conditions
    • How profit-driven hospitals fail long-term patient care

      John Corsino, DPT | Conditions
    • Complicity vs. protest: a doctor’s choice

      Patrick Hudson, MD | Physician
    • How physician burnout and system reform are shaping the future of U.S. health care

      Irim Salik, MD | Policy
    • How nature is inspiring the future of pain medicine

      Varun Mangal | Conditions

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

View 5 Comments >

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

ADVERTISEMENT

  • Most Popular

  • Past Week

    • Why doctors must fight for a just health care system

      Alankrita Olson, MD, MPH & Ashley Duhon, MD & Toby Terwilliger, MD | Policy
    • The human case for preserving the nipple after mastectomy

      Thomas Amburn, MD | Conditions
    • IMGs are the future of U.S. primary care

      Adam Brandon Bondoc, MD | Physician
    • How transplant recipients can pay it forward through organ donation

      Deepak Gupta, MD | Physician
    • Women physicians: How can they survive and thrive in academic medicine?

      Elina Maymind, MD | Physician
    • Why AI in health care needs stronger testing before clinical use [PODCAST]

      The Podcast by KevinMD | Podcast
  • Past 6 Months

    • Health equity in Inland Southern California requires urgent action

      Vishruth Nagam | Policy
    • How restrictive opioid policies worsen the crisis

      Kayvan Haddadan, MD | Physician
    • Why primary care needs better dermatology training

      Alex Siauw | Conditions
    • Why pain doctors face unfair scrutiny and harsh penalties in California

      Kayvan Haddadan, MD | Physician
    • How hospitals can prepare for CMS’s new patient safety rule

      Kim Adelman, PhD | Conditions
    • Why physician strikes are a form of hospice

      Patrick Hudson, MD | Physician
  • Recent Posts

    • How to transform your mindset by rewiring your brain with positive language [PODCAST]

      The Podcast by KevinMD | Podcast
    • What is a varicocele and how does it affect fertility?

      Martina Ambardjieva, MD, PhD | Conditions
    • How profit-driven hospitals fail long-term patient care

      John Corsino, DPT | Conditions
    • Complicity vs. protest: a doctor’s choice

      Patrick Hudson, MD | Physician
    • How physician burnout and system reform are shaping the future of U.S. health care

      Irim Salik, MD | Policy
    • How nature is inspiring the future of pain medicine

      Varun Mangal | Conditions

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Chance: The difference between an unlucky surgeon and a killer
5 comments

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...