Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
KevinMD
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking
KevinMD
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking
  • About KevinMD | Kevin Pho, MD
  • Be heard on social media’s leading physician voice
  • Contact Kevin
  • Discounted enhanced author page
  • DMCA Policy
  • Establishing, Managing, and Protecting Your Online Reputation: A Social Media Guide for Physicians and Medical Practices
  • Group vs. individual disability insurance for doctors: pros and cons
  • KevinMD influencer opportunities
  • Opinion and commentary by KevinMD
  • Physician burnout speakers to keynote your conference
  • Physician Coaching by KevinMD
  • Physician keynote speaker: Kevin Pho, MD
  • Physician Speaking by KevinMD: a boutique speakers bureau
  • Primary care physician in Nashua, NH | Kevin Pho, MD
  • Privacy Policy
  • Recommended services by KevinMD
  • Terms of Use Agreement
  • Thank you for subscribing to KevinMD
  • Thank you for upgrading to the KevinMD enhanced author page
  • The biggest mistake doctors make when purchasing disability insurance
  • The doctor’s guide to disability insurance: short-term vs. long-term
  • The KevinMD ToolKit
  • Upgrade to the KevinMD enhanced author page
  • Why own-occupation disability insurance is a must for doctors

Stop setting hospital benchmarks at the state average

Ashish Jha, MD, MPH
Policy
October 12, 2012
Share
Tweet
Share

Recently, I discovered the statewide report on quality of stroke care in Massachusetts.  It’s a plain document, mostly in black and white, much of what you might expect from a state government report.  Yet, this 4-page document is a reminder of how we have come to accept mediocrity as the standard in our healthcare delivery system.

The report is about 1,082 men and women in Massachusetts unfortunate enough to have a stroke but lucky (or vigilant) enough to get to one of the 69 Massachusetts hospitals designated as Primary Stroke Service (PSS) in a timely fashion. Indeed, all these patients arrived within 2 hours of onset of symptoms and none had a contradiction to IV-tPA, a powerful “clot busting” drug that has been known to dramatically improve outcomes in patients with ischemic stroke, a condition in which a blood clot is cutting off blood supply to the brain.  For many patient-ts, t-PA is the difference between living a highly functional life versus being debilitated and spending the rest of their lives in a nursing home.  There are very few things we do in medicine where minutes count – and tPA for stroke is one of them.

So what does this report tell us?  That during 2009-2010, patients who showed up to the ER in time to get this life-altering drug received in 83.3% of the time.  Most of us who study “quality of care” look at that number and think – well, that’s pretty good.  It surely could have been worse.

Pretty good?  Could have been worse?  Take a step back for a moment:  if your parent or spouse was having a stroke (horrible clot lodged in brain, killing brain cells by the minute) – you recognized it right away, called 911, and got your loved one to a Primary Stroke Service hospital in a fabulously short period of time, are you happy with a 1 in 5 chance that they won’t get the one life-altering drug we know works?  Only 1 in 5 chance that they might spend their life in a nursing home instead of coming home?  Is “pretty good” good enough for your loved one?

The Massachusetts Department of Health has put substantial effort in this area and the numbers have steadily improved.  By many accounts, this is a success story (the number was 66% in 2008, rising to 83.5% in 2011).  But this level of performance is not nearly good enough.

There are plenty of hospitals that seem to get it right.  I counted 14 that were at 100% and another dozen or so that might have missed it on one patient.  But here’s the problem.  From a clinical perspective, so few patients with stroke ever show up in the magic window of less than 4.5 hours of the onset of symptoms (that’s the cut-off for using t-PA) that the average hospital in Massachusetts sees about 8 such patients per year (less than one a month).  If you were unfortunate enough to end up at Lowell General, there was nearly a 40% chance (depending on which campus) that you won’t get tPA.  At Milton hospital, there was a 60% chance that you wouldn’t get tPA.  These numbers may be getting better slowly, but that’s cold comfort to those permanently disabled because hospitals haven’t yet put in the systems needed to reliably provide a therapy we’ve known is effective since 1995.

So what might state and federal policymakers do if they wanted to get serious about improving these rates?  There are lots of potential solutions, including greater training, more oversight, even robust pay-for-performance.  I have a simpler request:

Stop setting the benchmark at the state average.

In this report (like almost every other report card), you are judged against the “average”.  So, if your state is lousy, a lot of mediocre hospitals can look fine.  Instead, set a goal for what you want to achieve.  In this case, the goal is 100%.  Period.  Tell me which hospitals were “statistically” worse than 100%.  That’s a lot more meaningful than which hospitals were “statistically” worse than average.

In this report, 64 out of 69 hospitals were labeled “equal” because they weren’t statistically worse than average, including South Shore Hospital, which failed to provide t-PA to 8 of their 31 patients (26% failure rate).  Lucky for them, that’s not statistically worse than the state average of 17% failure – but perhaps not so lucky for those 8 patients.  For the 64 hospitals that are labeled as “equal”, such as South Shore, there is little motivation to improve.  Yet, I’m confident that South Shore would be having a very different set of internal discussions if the benchmark was 100%.

If we’re going to use transparency to improve, we need to choose the right benchmarks.  In situations in which strong, evidence-based processes are involved (like providing a life-saving drug), the benchmark should be 100%.  Benchmarking to the average is benchmarking to a “C”.  We spend a LOT of money on healthcare – we deserve better, and our hospitals can do better.  With all the knowledge and expertise in the medical field, we don’t have to settle for a “C”.  We should demand that our hospitals provide “A” care consistently and reliably to all their patients.

Ashish Jha is an Associate Professor of Health Policy and Management, Harvard School of Public Health.  He blogs at An Ounce of Evidence and can be found on Twitter @ashishkjha.

Prev

How our children turn out isn’t really up to us

October 11, 2012 Kevin 1
…
Next

A patient is not a dish off the menu

October 12, 2012 Kevin 8
…

Tagged as: Hospital-Based Medicine, Public Health & Policy

< Previous Post
How our children turn out isn’t really up to us
Next Post >
A patient is not a dish off the menu

ADVERTISEMENT

More by Ashish Jha, MD, MPH

  • Ranking the world’s health systems: These results may surprise you

    Ashish Jha, MD, MPH
  • How much does it matter which hospital you go to?

    Ashish Jha, MD, MPH
  • Men and women doctors versus correlation and causation

    Ashish Jha, MD, MPH

More in Policy

  • Florida health care legislation 2026: top bills to watch

    Del Carter, MD
  • Violence against health care workers: the silence must end

    Carleigh Beriont and June Zanes Garen, RN
  • Repeating history: the ethics of the new Guinea-Bissau hepatitis B study

    Meghan Johnston, MPH
  • The dangers of vertical integration in health care

    Stephanie Waggel, MD
  • The economic shift from fee-for-service to direct primary care

    Dana Y. Lujan, MBA
  • Artificial intelligence in clinical care: Shaping the HHS policy landscape

    Ido Zamberg, MD
  • Most Popular

  • Past Week

    • Politics and fear have replaced science in U.S. pain management [PODCAST]

      The Podcast by KevinMD | Podcast
    • Evidence-based medicine vs. clinical judgment: a medical student’s perspective

      Jay Pendyala | Education
    • The controversy over Maintenance of Certification for grandfathered physicians

      Bernard Leo Remakus, MD | Physician
    • When side effects are actually a cry for help with medication costs

      Shuchita Gupta, MD | Physician
    • The hidden math behind physician hiring costs and recruitment

      Timothy Lesaca, MD | Physician
    • The Schism of Time: Bridging the generational gap in the workplace

      Seleipiri Akobo, MD, MPH, MBA | Physician
  • Past 6 Months

    • The dangers of vertical integration in health care

      Stephanie Waggel, MD | Policy
    • Why does sex work seem like a more viable path than medicine in 2026?

      Corina Fratila, MD | Physician
    • The 9 laws of health care quality: Why metrics miss the point

      Constantine Ioannou, MD | Physician
    • Politics and fear have replaced science in U.S. pain management [PODCAST]

      The Podcast by KevinMD | Podcast
    • From Singapore to Canada: a blueprint for primary care transformation

      Ivy Oandasan, MD | Policy
    • How board certification fuels the physician shortage crisis

      Brian Hudes, MD | Physician
  • Recent Posts

    • Do no harm: Why physician burnout requires bottom-up reform

      Desiree Francis, MD | Physician
    • Institutional distrust in health care: Why a doctor lost faith

      Joshua Mirrer, MD | Physician
    • Communicating health to children: a pediatrician’s guide for parents

      Joey Skelton, MD | Conditions
    • Insulin resistance is a survival mechanism, not a broken system [PODCAST]

      The Podcast by KevinMD | Podcast
    • Debunking 4 myths about fertility treatments for women of color

      Ilana Ressler, MD | Physician
    • Whole-body MRI screening: a radiologist’s guide to preventive scans

      Amit Newatia, MD | Physician

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

View 1 Comments >

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

  • Most Popular

  • Past Week

    • Politics and fear have replaced science in U.S. pain management [PODCAST]

      The Podcast by KevinMD | Podcast
    • Evidence-based medicine vs. clinical judgment: a medical student’s perspective

      Jay Pendyala | Education
    • The controversy over Maintenance of Certification for grandfathered physicians

      Bernard Leo Remakus, MD | Physician
    • When side effects are actually a cry for help with medication costs

      Shuchita Gupta, MD | Physician
    • The hidden math behind physician hiring costs and recruitment

      Timothy Lesaca, MD | Physician
    • The Schism of Time: Bridging the generational gap in the workplace

      Seleipiri Akobo, MD, MPH, MBA | Physician
  • Past 6 Months

    • The dangers of vertical integration in health care

      Stephanie Waggel, MD | Policy
    • Why does sex work seem like a more viable path than medicine in 2026?

      Corina Fratila, MD | Physician
    • The 9 laws of health care quality: Why metrics miss the point

      Constantine Ioannou, MD | Physician
    • Politics and fear have replaced science in U.S. pain management [PODCAST]

      The Podcast by KevinMD | Podcast
    • From Singapore to Canada: a blueprint for primary care transformation

      Ivy Oandasan, MD | Policy
    • How board certification fuels the physician shortage crisis

      Brian Hudes, MD | Physician
  • Recent Posts

    • Do no harm: Why physician burnout requires bottom-up reform

      Desiree Francis, MD | Physician
    • Institutional distrust in health care: Why a doctor lost faith

      Joshua Mirrer, MD | Physician
    • Communicating health to children: a pediatrician’s guide for parents

      Joey Skelton, MD | Conditions
    • Insulin resistance is a survival mechanism, not a broken system [PODCAST]

      The Podcast by KevinMD | Podcast
    • Debunking 4 myths about fertility treatments for women of color

      Ilana Ressler, MD | Physician
    • Whole-body MRI screening: a radiologist’s guide to preventive scans

      Amit Newatia, MD | Physician

MedPage Today Professional

An Everyday Health Property Medpage Today

Copyright © 2026 KevinMD.com | Powered by Astra WordPress Theme

  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Stop setting hospital benchmarks at the state average
1 comments

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...