Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

Residents need to learn medicine, not how to pass a test

Eric W. Toth, DO
Education
August 14, 2017
Share
Tweet
Share

In his famous novel, Moneyball, Michael Lewis illustrates the phenomenon of professional baseball scouts focusing on all the wrong characteristics when looking at players. He describes how scouts focus on fastball velocity as a way to compare pitchers, despite the lack of correlation between fastball speed and the quality of a pitcher. As it turns out, the most important factor in a pitcher is deception, not a high-velocity fastball. The goal, after all, is to get batters out, not throw the hardest pitch. Lewis theorizes that because pitch speed is easy to measure, and easy to compare, it became overemphasized. The principle of overvaluing that which is easily measured is the same mistake made in graduate medical education in regards to test scores.

Every year, emergency medicine residents take a multiple choice test known colloquially known as the in service exam. The exam is an excellent predictor of the ability of a physician to eventually pass the board certification exam. The Accreditation Council for Graduate Medical Education (ACGME) monitors each residency program’s scores, and they are felt to reflect the quality of each programs education. Their logic is that if a program has low test scores, it must mean they are not properly educating their residents. The ACGME requires residency programs to have an 80 percent first-time pass rate on the board certification exam. If a program does not have adequate test success, programs can be placed on probation, and eventually be shut down. A lot of residency programs are feeling the pressure.

The problem with using multiple choice questions as a quality marker is that they are a poor indicator of clinical competency. In a multiple choice question, you are given a quick vignette, expected to make a single correct diagnosis, then answer a factual question about that diagnosis. Good test takers learn to cue into certain buzzwords that hint toward the correct answer. Doing well on the exam requires pattern recognition of different but similar question stems. It is a skill in itself, unfortunately, one that is useless when practicing actual medicine.

The thought process used for a multiple choice test is antithetical to medicine at the bedside. During training, we are taught to create a differential of possible diagnoses, then to systematically rule them in or out through a series of physical exam, laboratory, and radiology studies. Clinical medicine is subtle. Patients rarely present with a classic triad that you learn in the textbooks. Any experienced physician has a hundred personal stories about weird presentations, and patients that just don’t follow the rules.

The purpose of residency training is to produce competent emergency medicine physicians, but ACGME policies force residency programs to “teach to the test.” Every residency has a weekly lecture series called didactics that is a critical component of medical education. Increasingly, I have seen didactics time dominated with test prep sessions. We now spend time reviewing practice multiple choice questions instead of practical, patient centered case studies. I have even heard of programs limiting clinical hours in the emergency department for their residents in favor of board prep sessions.

The ACGME is making the same mistake with test scores as baseball scouts made with pitchers. I don’t mean to say that passing the board certification exam is meaningless, and there is no excuse for having a poor knowledge base, but test scores have simply been overemphasized. The value associated with answering multiple choice questions is out of proportion to their actual worth. It is easy to track and compare test scores, and so they are being used as a marker of quality. This is a mistake.

I fear the current test-centered approach toward residency education will lead to exactly what the ACGME has concocted; a generation of emergency physicians who are excellent at answering multiple choice questions, but aren’t as good at being an actual doctor.

Eric W. Toth is an emergency medicine resident.

Image credit: Shutterstock.com

Prev

A nurse was attacked in the emergency department. This is her story.

August 14, 2017 Kevin 2
…
Next

A code in the cath lab that was unlike anything I had ever seen

August 14, 2017 Kevin 0
…

Tagged as: Emergency Medicine, Medical school, Residency

Post navigation

< Previous Post
A nurse was attacked in the emergency department. This is her story.
Next Post >
A code in the cath lab that was unlike anything I had ever seen

ADVERTISEMENT

ADVERTISEMENT

ADVERTISEMENT

More by Eric W. Toth, DO

  • Race to the bottom: The myth of low-quality care in America

    Eric W. Toth, DO

Related Posts

  • What medicine can learn from a poem

    Thomas L. Amburn
  • Board reviews: How institutions can help students and residents pass their exams

    Sheryl Ramer
  • To graduating residents: You have already exceeded our expectations

    Christina Shenvi, MD, PhD
  • The difference between learning medicine and doing medicine

    Steven Zhang, MD
  • How social media can advance humanism in medicine

    Pooja Lakshmin, MD
  • From online education to frontline medicine

    Diana Ioana Rapolti, Deepika Khanna, Vivian Jin, and Shikha Jain, MD

More in Education

  • Why the pre-med path is pushing future doctors to the brink

    Jordan Williamson, MEd
  • Graduating from medical school without family: a story of strength and survival

    Anonymous
  • 2 hours to decide my future: How the SOAP residency match traps future doctors

    Nicolette V. S. Sewall, MD, MPH
  • What led me from nurse practitioner to medical school

    Sarah White, APRN
  • Bridging the rural surgical care gap with rotating health care teams

    Ankit Jain
  • Why tracking cognitive load could save doctors and patients

    Hiba Fatima Hamid
  • Most Popular

  • Past Week

    • Why removing fluoride from water is a public health disaster

      Steven J. Katz, DDS | Conditions
    • When did we start treating our lives like trauma?

      Maureen Gibbons, MD | Physician
    • First impressions happen online—not in your exam room

      Sara Meyer | Social media
    • AI is not a threat to radiologists. It’s a distraction from what truly matters in medicine.

      Fardad Behzadi, MD | Tech
    • Dedicated hypermobility clinics can transform patient care

      Katharina Schwan, MPH | Conditions
    • Why ADHD in adults is often missed—and why it matters [PODCAST]

      The Podcast by KevinMD | Podcast
  • Past 6 Months

    • Why tracking cognitive load could save doctors and patients

      Hiba Fatima Hamid | Education
    • What the world must learn from the life and death of Hind Rajab

      Saba Qaiser, RN | Conditions
    • The silent toll of ICE raids on U.S. patient care

      Carlin Lockwood | Policy
    • Why recovery after illness demands dignity, not suspicion

      Trisza Leann Ray, DO | Physician
    • Why does rifaximin cost 95 percent more in the U.S. than in Asia?

      Jai Kumar, MD, Brian Nohomovich, DO, PhD and Leonid Shamban, DO | Meds
    • Why medical students are trading empathy for publications

      Vijay Rajput, MD | Education
  • Recent Posts

    • AI is not a threat to radiologists. It’s a distraction from what truly matters in medicine.

      Fardad Behzadi, MD | Tech
    • How deep transcranial magnetic stimulation is transforming mental health care

      Muhamad Aly Rifai, MD | Conditions
    • True stories of doctors reclaiming their humanity in a system that challenges it

      Alae Kawam, DO & Kim Downey, PT & Nicole Solomos, DO | Physician
    • How Gen Z is transforming mental health care [PODCAST]

      The Podcast by KevinMD | Podcast
    • Nurses aren’t eating their young — we’re starving the profession

      Adam J. Wickett, BSN, RN | Conditions
    • Why wanting more from your medical career is a sign of strength

      Maureen Gibbons, MD | Physician

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

View 1 Comments >

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

ADVERTISEMENT

ADVERTISEMENT

ADVERTISEMENT

  • Most Popular

  • Past Week

    • Why removing fluoride from water is a public health disaster

      Steven J. Katz, DDS | Conditions
    • When did we start treating our lives like trauma?

      Maureen Gibbons, MD | Physician
    • First impressions happen online—not in your exam room

      Sara Meyer | Social media
    • AI is not a threat to radiologists. It’s a distraction from what truly matters in medicine.

      Fardad Behzadi, MD | Tech
    • Dedicated hypermobility clinics can transform patient care

      Katharina Schwan, MPH | Conditions
    • Why ADHD in adults is often missed—and why it matters [PODCAST]

      The Podcast by KevinMD | Podcast
  • Past 6 Months

    • Why tracking cognitive load could save doctors and patients

      Hiba Fatima Hamid | Education
    • What the world must learn from the life and death of Hind Rajab

      Saba Qaiser, RN | Conditions
    • The silent toll of ICE raids on U.S. patient care

      Carlin Lockwood | Policy
    • Why recovery after illness demands dignity, not suspicion

      Trisza Leann Ray, DO | Physician
    • Why does rifaximin cost 95 percent more in the U.S. than in Asia?

      Jai Kumar, MD, Brian Nohomovich, DO, PhD and Leonid Shamban, DO | Meds
    • Why medical students are trading empathy for publications

      Vijay Rajput, MD | Education
  • Recent Posts

    • AI is not a threat to radiologists. It’s a distraction from what truly matters in medicine.

      Fardad Behzadi, MD | Tech
    • How deep transcranial magnetic stimulation is transforming mental health care

      Muhamad Aly Rifai, MD | Conditions
    • True stories of doctors reclaiming their humanity in a system that challenges it

      Alae Kawam, DO & Kim Downey, PT & Nicole Solomos, DO | Physician
    • How Gen Z is transforming mental health care [PODCAST]

      The Podcast by KevinMD | Podcast
    • Nurses aren’t eating their young — we’re starving the profession

      Adam J. Wickett, BSN, RN | Conditions
    • Why wanting more from your medical career is a sign of strength

      Maureen Gibbons, MD | Physician

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Residents need to learn medicine, not how to pass a test
1 comments

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...