Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

Residents need to learn medicine, not how to pass a test

Eric W. Toth, DO
Education
August 14, 2017
Share
Tweet
Share

In his famous novel, Moneyball, Michael Lewis illustrates the phenomenon of professional baseball scouts focusing on all the wrong characteristics when looking at players. He describes how scouts focus on fastball velocity as a way to compare pitchers, despite the lack of correlation between fastball speed and the quality of a pitcher. As it turns out, the most important factor in a pitcher is deception, not a high-velocity fastball. The goal, after all, is to get batters out, not throw the hardest pitch. Lewis theorizes that because pitch speed is easy to measure, and easy to compare, it became overemphasized. The principle of overvaluing that which is easily measured is the same mistake made in graduate medical education in regards to test scores.

Every year, emergency medicine residents take a multiple choice test known colloquially known as the in service exam. The exam is an excellent predictor of the ability of a physician to eventually pass the board certification exam. The Accreditation Council for Graduate Medical Education (ACGME) monitors each residency program’s scores, and they are felt to reflect the quality of each programs education. Their logic is that if a program has low test scores, it must mean they are not properly educating their residents. The ACGME requires residency programs to have an 80 percent first-time pass rate on the board certification exam. If a program does not have adequate test success, programs can be placed on probation, and eventually be shut down. A lot of residency programs are feeling the pressure.

The problem with using multiple choice questions as a quality marker is that they are a poor indicator of clinical competency. In a multiple choice question, you are given a quick vignette, expected to make a single correct diagnosis, then answer a factual question about that diagnosis. Good test takers learn to cue into certain buzzwords that hint toward the correct answer. Doing well on the exam requires pattern recognition of different but similar question stems. It is a skill in itself, unfortunately, one that is useless when practicing actual medicine.

The thought process used for a multiple choice test is antithetical to medicine at the bedside. During training, we are taught to create a differential of possible diagnoses, then to systematically rule them in or out through a series of physical exam, laboratory, and radiology studies. Clinical medicine is subtle. Patients rarely present with a classic triad that you learn in the textbooks. Any experienced physician has a hundred personal stories about weird presentations, and patients that just don’t follow the rules.

The purpose of residency training is to produce competent emergency medicine physicians, but ACGME policies force residency programs to “teach to the test.” Every residency has a weekly lecture series called didactics that is a critical component of medical education. Increasingly, I have seen didactics time dominated with test prep sessions. We now spend time reviewing practice multiple choice questions instead of practical, patient centered case studies. I have even heard of programs limiting clinical hours in the emergency department for their residents in favor of board prep sessions.

The ACGME is making the same mistake with test scores as baseball scouts made with pitchers. I don’t mean to say that passing the board certification exam is meaningless, and there is no excuse for having a poor knowledge base, but test scores have simply been overemphasized. The value associated with answering multiple choice questions is out of proportion to their actual worth. It is easy to track and compare test scores, and so they are being used as a marker of quality. This is a mistake.

I fear the current test-centered approach toward residency education will lead to exactly what the ACGME has concocted; a generation of emergency physicians who are excellent at answering multiple choice questions, but aren’t as good at being an actual doctor.

Eric W. Toth is an emergency medicine resident.

Image credit: Shutterstock.com

Prev

A nurse was attacked in the emergency department. This is her story.

August 14, 2017 Kevin 2
…
Next

A code in the cath lab that was unlike anything I had ever seen

August 14, 2017 Kevin 0
…

Tagged as: Emergency Medicine, Medical school, Residency

Post navigation

< Previous Post
A nurse was attacked in the emergency department. This is her story.
Next Post >
A code in the cath lab that was unlike anything I had ever seen

ADVERTISEMENT

More by Eric W. Toth, DO

  • Race to the bottom: The myth of low-quality care in America

    Eric W. Toth, DO

Related Posts

  • What medicine can learn from a poem

    Thomas L. Amburn
  • Board reviews: How institutions can help students and residents pass their exams

    Sheryl Ramer
  • To graduating residents: You have already exceeded our expectations

    Christina Shenvi, MD, PhD
  • The difference between learning medicine and doing medicine

    Steven Zhang, MD
  • How social media can advance humanism in medicine

    Pooja Lakshmin, MD
  • From online education to frontline medicine

    Diana Ioana Rapolti, Deepika Khanna, Vivian Jin, and Shikha Jain, MD

More in Education

  • Dear July intern: It’s normal to feel clueless—here’s what matters

    Tomi Mitchell, MD
  • Why medical schools must ditch lectures and embrace active learning

    Arlen Meyers, MD, MBA
  • Why helping people means more than getting an MD

    Vaishali Jha
  • Residency match tips: Building mentorship, research, and community

    Simran Kaur, MD and Eva Shelton, MD
  • How I learned to stop worrying and love AI

    Rajeev Dutta
  • Why medical student debt is killing primary care in America

    Alexander Camp
  • Most Popular

  • Past Week

    • Forced voicemail and diagnosis codes are endangering patient access to medications

      Arthur Lazarus, MD, MBA | Meds
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy
    • America’s ER crisis: Why the system is collapsing from within

      Kristen Cline, BSN, RN | Conditions
    • Why timing, not surgery, determines patient survival

      Michael Karch, MD | Conditions
    • How early meetings and after-hours events penalize physician-mothers

      Samira Jeimy, MD, PhD and Menaka Pai, MD | Physician
    • FDA delays could end vital treatment for rare disease patients

      GJ van Londen, MD | Meds
  • Past 6 Months

    • Forced voicemail and diagnosis codes are endangering patient access to medications

      Arthur Lazarus, MD, MBA | Meds
    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
    • Why are medical students turning away from primary care? [PODCAST]

      The Podcast by KevinMD | Podcast
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy
    • Why “do no harm” might be harming modern medicine

      Sabooh S. Mubbashar, MD | Physician
    • Here’s what providers really need in a modern EHR

      Laura Kohlhagen, MD, MBA | Tech
  • Recent Posts

    • Addressing menstrual health inequities in adolescents

      Callia Georgoulis | Conditions
    • How to advance workforce development through research mentorship and evidence-based management

      Olumuyiwa Bamgbade, MD | Physician
    • The truth about perfection and identity in health care

      Ryan Nadelson, MD | Physician
    • Civil discourse as a leadership competency: the case for curiosity in medicine

      All Levels Leadership | Physician
    • Healing beyond the surface: Why proper chronic wound care matters

      Alvin May, MD | Conditions
    • Why specialist pain clinics and addiction treatment services require strong primary care

      Olumuyiwa Bamgbade, MD | Conditions

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

View 1 Comments >

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

  • Most Popular

  • Past Week

    • Forced voicemail and diagnosis codes are endangering patient access to medications

      Arthur Lazarus, MD, MBA | Meds
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy
    • America’s ER crisis: Why the system is collapsing from within

      Kristen Cline, BSN, RN | Conditions
    • Why timing, not surgery, determines patient survival

      Michael Karch, MD | Conditions
    • How early meetings and after-hours events penalize physician-mothers

      Samira Jeimy, MD, PhD and Menaka Pai, MD | Physician
    • FDA delays could end vital treatment for rare disease patients

      GJ van Londen, MD | Meds
  • Past 6 Months

    • Forced voicemail and diagnosis codes are endangering patient access to medications

      Arthur Lazarus, MD, MBA | Meds
    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
    • Why are medical students turning away from primary care? [PODCAST]

      The Podcast by KevinMD | Podcast
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy
    • Why “do no harm” might be harming modern medicine

      Sabooh S. Mubbashar, MD | Physician
    • Here’s what providers really need in a modern EHR

      Laura Kohlhagen, MD, MBA | Tech
  • Recent Posts

    • Addressing menstrual health inequities in adolescents

      Callia Georgoulis | Conditions
    • How to advance workforce development through research mentorship and evidence-based management

      Olumuyiwa Bamgbade, MD | Physician
    • The truth about perfection and identity in health care

      Ryan Nadelson, MD | Physician
    • Civil discourse as a leadership competency: the case for curiosity in medicine

      All Levels Leadership | Physician
    • Healing beyond the surface: Why proper chronic wound care matters

      Alvin May, MD | Conditions
    • Why specialist pain clinics and addiction treatment services require strong primary care

      Olumuyiwa Bamgbade, MD | Conditions

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Residents need to learn medicine, not how to pass a test
1 comments

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...