Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

Multiple choice questions are a terrible way to test doctors

Jeremy Gabrysch, MD
Physician
August 9, 2016
Share
Tweet
Share

Most people are surprised to hear that the way doctors are recertified every ten years is through a multiple choice test. “Really?” they’ll say. “You take a multiple choice test? As a doctor?”

Unfortunately, after all these years that’s the most efficient way we can think of to evaluate professionals. But the method is so flawed. And your ability to answer questions on the multiple choice test isn’t necessarily linked with your ability to be a good clinician. Take a look at this question, for example:

Which of the following statements regarding deep venous thrombosis is correct?

  1. Most calf vein thrombi extend into the proximal deep veins, usually within a week after presentation.
  2. Most patients have classical physical examination findings.
  3. Pregnancy is a predictor according to the Wells criteria.
  4. Up to 10 to 15 percent of calf vein thrombi result in pulmonary emboli

Every good doctor knows that a patient with a swollen leg raises the concern for a deep venous thrombosis (DVT): a blood clot in the veins of the leg. This question is trying to ascertain whether the clinician understands the approach to the diagnosis of DVT. But look at the answers.

The important concept being tested with answer choice “A” is whether or not calf vein clots (“thrombi”) can extend into the thigh veins, and indeed they do. Does it matter if most of them do or some of them do? Probably not. Many aspects of this answer are just tricks. As a doctor, I know that it’s possible for a calf DVT to extend to a thigh DVT. But answer choice “A” is actually wrong because only some calf clots extend. Not most.

Choice “B” says, “Most patients have classic physical exam findings.” Studies have shown that the sensitivity for leg swelling (classic physical exam finding) is anywhere from 35 percent to 95 percent. So would you say that most have classical physical exam findings? I guess it depends whether you go with the study that showed 35 percent or the one that showed 95 percent. The examiner is expecting you’ll go with 35 percent, as he means for this to be an incorrect answer.

The next answer choice “C” says, “Pregnancy is a predictor according to the Wells criteria.” This statement is in here to throw you off, because pregnancy is not technically part of the Wells criteria. The Wells criteria help determine what patients are at high risk for DVT. Despite this, you would be hard pressed to find a clinician with a pregnant patient with a swollen leg who would not order an ultrasound to rule out DVT. We’ve all seen it enough times. The pregnant lady with the clot in her leg. So this answer, while technically false, is practically useless.

The last answer choice “D” is the correct one according to the examiner. It says up to 10 to 15 percent of calf thrombi result in PE (a blood clot in the lungs). But how important is this actual percentage number? The important concept here is, “Do calf vein thrombi ever result in pulmonary emboli?” and the answer is, “Yes, some of them do.”

But is it 10 to 15 percent? Is it is it 30 percent? Is it 45 percent? Who cares. The truth is, I’m a practicing emergency physician for the past 13 years, and I don’t know the exact percentage of calf thrombi that result in pulmonary embolism. I do know that it can happen, but not very often. Isn’t that good enough? No. According to the writers of the standardized tests, I should know the exact percentage

I get that test questions are difficult to write. But often the veracity of one answer choice rests on some statistic that most physicians are not going to know on the tip of the tongue. Sure, I can study for a few months and try to cram as many of these facts in my head as I can. But the point is: When I’m at your bedside, and you have been pregnant, and your calf hurts, I know that DVT is a possible diagnosis. I will search for it, and exclude it, or find it. Isn’t that more important than whether I can tell you the exact statistical numbers?

There’s got to be a better way. Recently the American Board of Anesthesiology decided to stop administering its 10-year multiple choice “recertification exam” to experienced anesthesiologists. This just seems like common sense. The state bar does not administer multiple choice question choice questions to seasoned lawyers after decades of practice. And clinicians who are doing a good job of keeping up with the literature should not be asked to do the same. Continuing education requirements already help ensure that doctors are keeping on top of things. Why continue this archaic practice of giving multiple choice tests over obscure facts every ten years? It’s just not necessary.

Jeremy Gabrysch is an emergency physician.

Image credit: Shutterstock.com

ADVERTISEMENT

Prev

Watch how pathologists ensure the blood supply is safe

August 9, 2016 Kevin 0
…
Next

This oncologist says the USPSTF gets it wrong on skin cancer screening

August 9, 2016 Kevin 18
…

Tagged as: Emergency Medicine, Hematology

Post navigation

< Previous Post
Watch how pathologists ensure the blood supply is safe
Next Post >
This oncologist says the USPSTF gets it wrong on skin cancer screening

ADVERTISEMENT

Related Posts

  • There are drawbacks when multiple layers are placed between patient and physician

    Elaine Walizer
  • Why do doctors who hate being doctors still practice?

    Kristin Puhl, MD
  • Doctors die. But the good ones leave a legacy.

    Jaime B. Gerber, MD
  • Doctors: It’s time to unionize

    Thomas D. Guastavino, MD
  • When doctors are right

    Sophia Zilber
  • Many questions remain about medical marijuana

    Steven Reznick, MD

More in Physician

  • How to handle chronically late patients in your medical practice

    Neil Baum, MD
  • How early meetings and after-hours events penalize physician-mothers

    Samira Jeimy, MD, PhD and Menaka Pai, MD
  • Why medicine must evolve to support modern physicians

    Ryan Nadelson, MD
  • Why listening to parents’ intuition can save lives in pediatric care

    Tokunbo Akande, MD, MPH
  • Finding balance and meaning in medical practice: a holistic approach to professional fulfillment

    Dr. Saad S. Alshohaib
  • How regulatory overreach is destroying innovation in U.S. health care

    Kayvan Haddadan, MD
  • Most Popular

  • Past Week

    • Forced voicemail and diagnosis codes are endangering patient access to medications

      Arthur Lazarus, MD, MBA | Meds
    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy
    • Why timing, not surgery, determines patient survival

      Michael Karch, MD | Conditions
    • Why health care leaders fail at execution—and how to fix it

      Dave Cummings, RN | Policy
    • How digital tools are reshaping the doctor-patient relationship

      Vineet Vishwanath | Tech
  • Past 6 Months

    • Forced voicemail and diagnosis codes are endangering patient access to medications

      Arthur Lazarus, MD, MBA | Meds
    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
    • Why are medical students turning away from primary care? [PODCAST]

      The Podcast by KevinMD | Podcast
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy
    • Why “do no harm” might be harming modern medicine

      Sabooh S. Mubbashar, MD | Physician
    • The hidden health risks in the One Big Beautiful Bill Act

      Trevor Lyford, MPH | Policy
  • Recent Posts

    • Why point-of-care ultrasound belongs in every emergency department triage [PODCAST]

      The Podcast by KevinMD | Podcast
    • Why PSA levels alone shouldn’t define your prostate cancer risk

      Martina Ambardjieva, MD, PhD | Conditions
    • How to handle chronically late patients in your medical practice

      Neil Baum, MD | Physician
    • Reframing chronic pain and dignity: What a pain clinic teaches us about MAiD and chronic suffering

      Olumuyiwa Bamgbade, MD | Conditions
    • How early meetings and after-hours events penalize physician-mothers

      Samira Jeimy, MD, PhD and Menaka Pai, MD | Physician
    • Why medicine must evolve to support modern physicians

      Ryan Nadelson, MD | Physician

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

View 4 Comments >

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

  • Most Popular

  • Past Week

    • Forced voicemail and diagnosis codes are endangering patient access to medications

      Arthur Lazarus, MD, MBA | Meds
    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy
    • Why timing, not surgery, determines patient survival

      Michael Karch, MD | Conditions
    • Why health care leaders fail at execution—and how to fix it

      Dave Cummings, RN | Policy
    • How digital tools are reshaping the doctor-patient relationship

      Vineet Vishwanath | Tech
  • Past 6 Months

    • Forced voicemail and diagnosis codes are endangering patient access to medications

      Arthur Lazarus, MD, MBA | Meds
    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
    • Why are medical students turning away from primary care? [PODCAST]

      The Podcast by KevinMD | Podcast
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy
    • Why “do no harm” might be harming modern medicine

      Sabooh S. Mubbashar, MD | Physician
    • The hidden health risks in the One Big Beautiful Bill Act

      Trevor Lyford, MPH | Policy
  • Recent Posts

    • Why point-of-care ultrasound belongs in every emergency department triage [PODCAST]

      The Podcast by KevinMD | Podcast
    • Why PSA levels alone shouldn’t define your prostate cancer risk

      Martina Ambardjieva, MD, PhD | Conditions
    • How to handle chronically late patients in your medical practice

      Neil Baum, MD | Physician
    • Reframing chronic pain and dignity: What a pain clinic teaches us about MAiD and chronic suffering

      Olumuyiwa Bamgbade, MD | Conditions
    • How early meetings and after-hours events penalize physician-mothers

      Samira Jeimy, MD, PhD and Menaka Pai, MD | Physician
    • Why medicine must evolve to support modern physicians

      Ryan Nadelson, MD | Physician

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Multiple choice questions are a terrible way to test doctors
4 comments

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...