Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

Multiple choice questions are a terrible way to test doctors

Jeremy Gabrysch, MD
Physician
August 9, 2016
Share
Tweet
Share

Most people are surprised to hear that the way doctors are recertified every ten years is through a multiple choice test. “Really?” they’ll say. “You take a multiple choice test? As a doctor?”

Unfortunately, after all these years that’s the most efficient way we can think of to evaluate professionals. But the method is so flawed. And your ability to answer questions on the multiple choice test isn’t necessarily linked with your ability to be a good clinician. Take a look at this question, for example:

Which of the following statements regarding deep venous thrombosis is correct?

  1. Most calf vein thrombi extend into the proximal deep veins, usually within a week after presentation.
  2. Most patients have classical physical examination findings.
  3. Pregnancy is a predictor according to the Wells criteria.
  4. Up to 10 to 15 percent of calf vein thrombi result in pulmonary emboli

Every good doctor knows that a patient with a swollen leg raises the concern for a deep venous thrombosis (DVT): a blood clot in the veins of the leg. This question is trying to ascertain whether the clinician understands the approach to the diagnosis of DVT. But look at the answers.

The important concept being tested with answer choice “A” is whether or not calf vein clots (“thrombi”) can extend into the thigh veins, and indeed they do. Does it matter if most of them do or some of them do? Probably not. Many aspects of this answer are just tricks. As a doctor, I know that it’s possible for a calf DVT to extend to a thigh DVT. But answer choice “A” is actually wrong because only some calf clots extend. Not most.

Choice “B” says, “Most patients have classic physical exam findings.” Studies have shown that the sensitivity for leg swelling (classic physical exam finding) is anywhere from 35 percent to 95 percent. So would you say that most have classical physical exam findings? I guess it depends whether you go with the study that showed 35 percent or the one that showed 95 percent. The examiner is expecting you’ll go with 35 percent, as he means for this to be an incorrect answer.

The next answer choice “C” says, “Pregnancy is a predictor according to the Wells criteria.” This statement is in here to throw you off, because pregnancy is not technically part of the Wells criteria. The Wells criteria help determine what patients are at high risk for DVT. Despite this, you would be hard pressed to find a clinician with a pregnant patient with a swollen leg who would not order an ultrasound to rule out DVT. We’ve all seen it enough times. The pregnant lady with the clot in her leg. So this answer, while technically false, is practically useless.

The last answer choice “D” is the correct one according to the examiner. It says up to 10 to 15 percent of calf thrombi result in PE (a blood clot in the lungs). But how important is this actual percentage number? The important concept here is, “Do calf vein thrombi ever result in pulmonary emboli?” and the answer is, “Yes, some of them do.”

But is it 10 to 15 percent? Is it is it 30 percent? Is it 45 percent? Who cares. The truth is, I’m a practicing emergency physician for the past 13 years, and I don’t know the exact percentage of calf thrombi that result in pulmonary embolism. I do know that it can happen, but not very often. Isn’t that good enough? No. According to the writers of the standardized tests, I should know the exact percentage

I get that test questions are difficult to write. But often the veracity of one answer choice rests on some statistic that most physicians are not going to know on the tip of the tongue. Sure, I can study for a few months and try to cram as many of these facts in my head as I can. But the point is: When I’m at your bedside, and you have been pregnant, and your calf hurts, I know that DVT is a possible diagnosis. I will search for it, and exclude it, or find it. Isn’t that more important than whether I can tell you the exact statistical numbers?

There’s got to be a better way. Recently the American Board of Anesthesiology decided to stop administering its 10-year multiple choice “recertification exam” to experienced anesthesiologists. This just seems like common sense. The state bar does not administer multiple choice question choice questions to seasoned lawyers after decades of practice. And clinicians who are doing a good job of keeping up with the literature should not be asked to do the same. Continuing education requirements already help ensure that doctors are keeping on top of things. Why continue this archaic practice of giving multiple choice tests over obscure facts every ten years? It’s just not necessary.

Jeremy Gabrysch is an emergency physician.

Image credit: Shutterstock.com

ADVERTISEMENT

Prev

Watch how pathologists ensure the blood supply is safe

August 9, 2016 Kevin 0
…
Next

This oncologist says the USPSTF gets it wrong on skin cancer screening

August 9, 2016 Kevin 18
…

Tagged as: Emergency Medicine, Hematology

Post navigation

< Previous Post
Watch how pathologists ensure the blood supply is safe
Next Post >
This oncologist says the USPSTF gets it wrong on skin cancer screening

ADVERTISEMENT

Related Posts

  • There are drawbacks when multiple layers are placed between patient and physician

    Elaine Walizer
  • Why do doctors who hate being doctors still practice?

    Kristin Puhl, MD
  • Doctors die. But the good ones leave a legacy.

    Jaime B. Gerber, MD
  • Doctors: It’s time to unionize

    Thomas D. Guastavino, MD
  • When doctors are right

    Sophia Zilber
  • Many questions remain about medical marijuana

    Steven Reznick, MD

More in Physician

  • The shocking risk every smart student faces when applying to medical school

    Curtis G. Graham, MD
  • The physician who turned burnout into a mission for change

    Jessie Mahoney, MD
  • Time theft: the unseen harm of abusive oversight

    Kayvan Haddadan, MD
  • Why more doctors are leaving clinical practice and how it helps health care

    Arlen Meyers, MD, MBA
  • Harassment and overreach are driving physicians to quit

    Olumuyiwa Bamgbade, MD
  • Why starting with why can transform your medical practice

    Neil Baum, MD
  • Most Popular

  • Past Week

    • Who gets to be well in America: Immigrant health is on the line

      Joshua Vasquez, MD | Policy
    • Why specialist pain clinics and addiction treatment services require strong primary care

      Olumuyiwa Bamgbade, MD | Conditions
    • Harassment and overreach are driving physicians to quit

      Olumuyiwa Bamgbade, MD | Physician
    • Why peer support can save lives in high-pressure medical careers

      Maire Daugharty, MD | Conditions
    • When a medical office sublease turns into a legal nightmare

      Ralph Messo, DO | Physician
    • Addressing menstrual health inequities in adolescents

      Callia Georgoulis | Conditions
  • Past 6 Months

    • Forced voicemail and diagnosis codes are endangering patient access to medications

      Arthur Lazarus, MD, MBA | Meds
    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
    • Why are medical students turning away from primary care? [PODCAST]

      The Podcast by KevinMD | Podcast
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy
    • Who gets to be well in America: Immigrant health is on the line

      Joshua Vasquez, MD | Policy
    • Why “do no harm” might be harming modern medicine

      Sabooh S. Mubbashar, MD | Physician
  • Recent Posts

    • The shocking risk every smart student faces when applying to medical school

      Curtis G. Graham, MD | Physician
    • Clinical ghosts and why they haunt our exam rooms

      Kara Wada, MD | Conditions
    • High blood pressure’s hidden impact on kidney health in older adults

      Edmond Kubi Appiah, MPH | Conditions
    • Deep transcranial magnetic stimulation for depression [PODCAST]

      The Podcast by KevinMD | Podcast
    • How declining MMR vaccination rates put future generations at risk

      Ambika Sharma, Onyi Oligbo, and Katrina Green, MD | Conditions
    • The physician who turned burnout into a mission for change

      Jessie Mahoney, MD | Physician

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

View 4 Comments >

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

  • Most Popular

  • Past Week

    • Who gets to be well in America: Immigrant health is on the line

      Joshua Vasquez, MD | Policy
    • Why specialist pain clinics and addiction treatment services require strong primary care

      Olumuyiwa Bamgbade, MD | Conditions
    • Harassment and overreach are driving physicians to quit

      Olumuyiwa Bamgbade, MD | Physician
    • Why peer support can save lives in high-pressure medical careers

      Maire Daugharty, MD | Conditions
    • When a medical office sublease turns into a legal nightmare

      Ralph Messo, DO | Physician
    • Addressing menstrual health inequities in adolescents

      Callia Georgoulis | Conditions
  • Past 6 Months

    • Forced voicemail and diagnosis codes are endangering patient access to medications

      Arthur Lazarus, MD, MBA | Meds
    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
    • Why are medical students turning away from primary care? [PODCAST]

      The Podcast by KevinMD | Podcast
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy
    • Who gets to be well in America: Immigrant health is on the line

      Joshua Vasquez, MD | Policy
    • Why “do no harm” might be harming modern medicine

      Sabooh S. Mubbashar, MD | Physician
  • Recent Posts

    • The shocking risk every smart student faces when applying to medical school

      Curtis G. Graham, MD | Physician
    • Clinical ghosts and why they haunt our exam rooms

      Kara Wada, MD | Conditions
    • High blood pressure’s hidden impact on kidney health in older adults

      Edmond Kubi Appiah, MPH | Conditions
    • Deep transcranial magnetic stimulation for depression [PODCAST]

      The Podcast by KevinMD | Podcast
    • How declining MMR vaccination rates put future generations at risk

      Ambika Sharma, Onyi Oligbo, and Katrina Green, MD | Conditions
    • The physician who turned burnout into a mission for change

      Jessie Mahoney, MD | Physician

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Multiple choice questions are a terrible way to test doctors
4 comments

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...