Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

Chance: The difference between an unlucky surgeon and a killer

Skeptical Scalpel, MD
Physician
September 15, 2014
Share
Tweet
Share

Risk-adjusted 30- to 90-day outcome data for selected types of operations done by specific surgeons and hospitals are now being publicly posted online by England’s National Health Service.

According to the site, “Any hospital or consultant [attending surgeon in the UK] identified as an outlier will be investigated and action taken to improve data quality and/or patient care.”

After cardiac surgery outcomes data were made public in New York, some interesting unexpected consequences were noted.

Surgeons and hospitals resorted to gaming the system by declining to operate on patients who were high-risk and tinkering with patient charts to make those they did operate on seem sicker. This can be done by scouring the charts for all co-morbidities and making sure none are overlooked when they are coded. An article from New York Magazine explains it in more detail.

Interpreting outcomes data can be tricky.

In a post three years ago about a report that nine Maryland hospitals had higher-than-average complication rates, I pointed out that whenever you have averages, some hospitals are going to be worse than average unless all hospitals perform exactly the same way or, like medical students, are all above average.

A much more sophisticated way of looking at this subject appeared in a fascinating 2010 BBC News piece by Michael Blastland, who is the Nate Silver of England (or maybe Nate Silver is the Michael Blastland of the U.S.), called “Can chance make you a killer?”

Blastland set up a statistical chance calculator for a hypothetical set of 100 hospitals or 100 surgeons performing 100 operations each. The model assumes that every patient has the same chance of dying and that every surgeon is equally competent. The standard is that a mortality rate 60% worse than the norm set by the government for any hospital or surgeon is not acceptable.

You are assigned one hospital. Using a slider, you may choose an operative mortality rate anywhere from 1% to 15%. After you do this a number of times and recalculate for each mortality rate, you will notice that the number of unacceptably performing hospitals or surgeons changes randomly for each percent mortality and your hospital may appear in the underperforming group strictly by chance alone.

The whole concept is explained in more detail on the site. I encourage you to try it for yourself.

So it may be difficult for the NHS to separate the true outliers from the unlucky surgeons who happened to fall outside the established norms.

“Skeptical Scalpel” is a surgeon blogs at his self-titled site, Skeptical Scalpel.

Prev

Want doctors to be more emotionally available? Stop emasculating them.

September 15, 2014 Kevin 33
…
Next

Alternative medicine: There should only be one standard

September 16, 2014 Kevin 0
…

ADVERTISEMENT

Tagged as: Surgery

Post navigation

< Previous Post
Want doctors to be more emotionally available? Stop emasculating them.
Next Post >
Alternative medicine: There should only be one standard

ADVERTISEMENT

More by Skeptical Scalpel, MD

  • The hospital CEO who made a surgical incision. What happened?

    Skeptical Scalpel, MD
  • Medical error is not the third leading cause of death

    Skeptical Scalpel, MD
  • Should speed-eating contests be banned?

    Skeptical Scalpel, MD

More in Physician

  • The shocking risk every smart student faces when applying to medical school

    Curtis G. Graham, MD
  • The physician who turned burnout into a mission for change

    Jessie Mahoney, MD
  • Time theft: the unseen harm of abusive oversight

    Kayvan Haddadan, MD
  • Why more doctors are leaving clinical practice and how it helps health care

    Arlen Meyers, MD, MBA
  • Harassment and overreach are driving physicians to quit

    Olumuyiwa Bamgbade, MD
  • Why starting with why can transform your medical practice

    Neil Baum, MD
  • Most Popular

  • Past Week

    • Who gets to be well in America: Immigrant health is on the line

      Joshua Vasquez, MD | Policy
    • Why specialist pain clinics and addiction treatment services require strong primary care

      Olumuyiwa Bamgbade, MD | Conditions
    • Harassment and overreach are driving physicians to quit

      Olumuyiwa Bamgbade, MD | Physician
    • Why peer support can save lives in high-pressure medical careers

      Maire Daugharty, MD | Conditions
    • When a medical office sublease turns into a legal nightmare

      Ralph Messo, DO | Physician
    • Addressing menstrual health inequities in adolescents

      Callia Georgoulis | Conditions
  • Past 6 Months

    • Forced voicemail and diagnosis codes are endangering patient access to medications

      Arthur Lazarus, MD, MBA | Meds
    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
    • Why are medical students turning away from primary care? [PODCAST]

      The Podcast by KevinMD | Podcast
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy
    • Who gets to be well in America: Immigrant health is on the line

      Joshua Vasquez, MD | Policy
    • Why “do no harm” might be harming modern medicine

      Sabooh S. Mubbashar, MD | Physician
  • Recent Posts

    • The shocking risk every smart student faces when applying to medical school

      Curtis G. Graham, MD | Physician
    • Clinical ghosts and why they haunt our exam rooms

      Kara Wada, MD | Conditions
    • High blood pressure’s hidden impact on kidney health in older adults

      Edmond Kubi Appiah, MPH | Conditions
    • Deep transcranial magnetic stimulation for depression [PODCAST]

      The Podcast by KevinMD | Podcast
    • How declining MMR vaccination rates put future generations at risk

      Ambika Sharma, Onyi Oligbo, and Katrina Green, MD | Conditions
    • The physician who turned burnout into a mission for change

      Jessie Mahoney, MD | Physician

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

View 5 Comments >

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

  • Most Popular

  • Past Week

    • Who gets to be well in America: Immigrant health is on the line

      Joshua Vasquez, MD | Policy
    • Why specialist pain clinics and addiction treatment services require strong primary care

      Olumuyiwa Bamgbade, MD | Conditions
    • Harassment and overreach are driving physicians to quit

      Olumuyiwa Bamgbade, MD | Physician
    • Why peer support can save lives in high-pressure medical careers

      Maire Daugharty, MD | Conditions
    • When a medical office sublease turns into a legal nightmare

      Ralph Messo, DO | Physician
    • Addressing menstrual health inequities in adolescents

      Callia Georgoulis | Conditions
  • Past 6 Months

    • Forced voicemail and diagnosis codes are endangering patient access to medications

      Arthur Lazarus, MD, MBA | Meds
    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
    • Why are medical students turning away from primary care? [PODCAST]

      The Podcast by KevinMD | Podcast
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy
    • Who gets to be well in America: Immigrant health is on the line

      Joshua Vasquez, MD | Policy
    • Why “do no harm” might be harming modern medicine

      Sabooh S. Mubbashar, MD | Physician
  • Recent Posts

    • The shocking risk every smart student faces when applying to medical school

      Curtis G. Graham, MD | Physician
    • Clinical ghosts and why they haunt our exam rooms

      Kara Wada, MD | Conditions
    • High blood pressure’s hidden impact on kidney health in older adults

      Edmond Kubi Appiah, MPH | Conditions
    • Deep transcranial magnetic stimulation for depression [PODCAST]

      The Podcast by KevinMD | Podcast
    • How declining MMR vaccination rates put future generations at risk

      Ambika Sharma, Onyi Oligbo, and Katrina Green, MD | Conditions
    • The physician who turned burnout into a mission for change

      Jessie Mahoney, MD | Physician

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Chance: The difference between an unlucky surgeon and a killer
5 comments

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...