Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

Multiple choice tests in our post-truth world

Paul Marantz, MD, MPH
Physician
February 28, 2017
Share
Tweet
Share

It has been purported that one of the major take-home messages from the bizarre events of 2016 is that we are now living in a “post-truth” world. Indeed, that very phrase was dubbed the “word of the year” by Oxford Dictionaries, which defines it as “relating to or denoting circumstances in which objective facts are less influential in shaping public opinion than appeals to emotion and personal belief.”

We are also seeing a growing level of mistrust of science among Americans. From the climate-change deniers to the anti-vaxxers, we seem to be increasingly comfortable with the idea that we can choose to believe whatever we want, along with the related notion that “experts” are less reliable than the general public.

As a scientist, I am troubled by the notion that emotion or personal belief would trump (forgive the pun) objective reality. But also as a scientist, I understand that facts themselves aren’t sufficient to create a model of reality—and as a former philosophy student, I choose the phrase “model of reality” because, while properly interpreted and analyzed facts are necessary in the quest for meaningful knowledge, ultimate “truth” is unknowable.

From this perspective, therefore, “facts” are necessary but not sufficient for understanding the universe. Not only must there be a clear ability to distinguish purported “facts” from fiction, including an ability to distinguish truths of logic from facts derived empirically (the former are immutable; the latter may change with new information); we also must critically and carefully interpret the available facts within a conceptual or theoretical framework. If this notion makes you uncomfortable, there’s only one thing I can say: tough noogies. If you want to live in a world of revealed truth, go enter a monastery. If you want to live in the real world, then learn to live with it.

I have the great honor of teaching future physicians and future researchers, and try to help my learners address the challenge of making valid inferences from the facts they know or the data they’re interpreting. Unfortunately, starting in grade school and continuing through grad school, our educational system remains mired in an old model that continues to prize “fact retention” over analytic ability—a model that is increasingly irrelevant because, with information ever at our fingertips (right there on our smartphones), there is less need than ever before to retain facts, and conversely a greater need than ever to analyze them critically to draw reasonable conclusions. This has created the perfect situation for a post-truth world: unfettered access to (real or fake) information, and limited ability to make reasoned judgments about or with this information.

So why do educators persist in valuing fact memorization and regurgitation over reasoned judgment? The sad answer is that it’s a lot easier to measure what people know than how they think, and we need metrics to adjudicate educational achievement. All that’s needed to test factual knowledge are some agreed-upon facts and some multiple-choice questions; measuring the true goal of education, the achievement of competency, is much more elusive. And since testing drives learning (as in the aphorism “People don’t respect what you expect, they respect what you inspect”), this approach pushes learners to overvalue factual knowledge at the expense of analytic ability. Whether we look at the overall failure of “no child left behind” in primary education or the stranglehold the U.S. Medical Licensure Examination (USMLE) has on medical education, we seem to exist in two parallel universes simultaneously: one that is “post-truth,” and one that values nothing other than the (generally agreed-upon catechism we accept as) facts, which we erroneously label “truth.”

But even as we bow before the gods of facts, we also understand the importance of this concept (one of my favorite Albert Einstein quotes that is, alas, not his — “fact-checking” can sometimes be painful!): “Not everything that can be counted counts, and not everything that counts can be counted.” We recognize the importance of “competency-based education,” but downplay the challenges of assessing competency achievement—thus perpetuating the convenient assessment of factual knowledge. It is in this context that my colleagues and I recently published our strong objection to a new “certification” examination for clinical researchers: a (you guessed it) multiple-choice test of factual information being promulgated by the National Board of Medical Examiners, the same organization that brings us (and resists changes to) the USMLE.

We lay out our arguments against this exam in this editorial. I am especially troubled because, as someone who has been educating clinical researchers for many years, I actually know how to measure their competency: most importantly, by evaluating the quality and impact of their research, and also (indirectly) by examining their professional track records (through such metrics as publications, grants and promotions). While one can argue that these metrics are imperfect — and some potentially more enlightened (although harder to measure) scales have been proposed — they are certainly better, and more aligned with competency assessment, than a multiple choice test could ever be.

Many of us will choose to fight against accepting the notion that we are entering a “post-truth” era. To fight that good fight, we must acknowledge that “truth” is an elusive concept requiring the analysis and application of factual information, and advocate for educational (and testing) approaches that will yield the educated citizenry that Thomas Jefferson recognized as a cornerstone of democracy.

Paul Marantz is associate dean, clinical research education and director, Center for Public Health Sciences, Albert Einstein College of Medicine, Bronx, NY. He blogs at the Doctor’s Tablet.

Image credit: Shutterstock.com

Prev

Don’t forget that we're not just women, we're doctors

February 28, 2017 Kevin 14
…
Next

What this physician learned from a dying patient

February 28, 2017 Kevin 0
…

Tagged as: Primary Care

Post navigation

< Previous Post
Don’t forget that we're not just women, we're doctors
Next Post >
What this physician learned from a dying patient

ADVERTISEMENT

ADVERTISEMENT

ADVERTISEMENT

More by Paul Marantz, MD, MPH

  • Why we must be cautious about hydroxychloroquine

    Paul Marantz, MD, MPH
  • More guns or fewer? The problems with evidence-based gun research

    Paul Marantz, MD, MPH
  • The problem of expert fallacy in cancer screening guidelines

    Paul Marantz, MD, MPH

Related Posts

  • There are drawbacks when multiple layers are placed between patient and physician

    Elaine Walizer
  • The post-baccalaureate pre-health program experience

    Sheindel Ifrah
  • Beware of food sensitivity tests on Facebook

    Roy Benaroch, MD
  • The truth about Caribbean medical schools

    Jessica K. Willett, MD
  • A physician’s addiction to social media

    Amanda Xi, MD
  • Patients in Sweden received fewer post-op opioids. Why is that?

    Richard Young, MD

More in Physician

  • The dreaded question: Do you have boys or girls?

    Pamela Adelstein, MD
  • When rock bottom is a turning point: Why the turmoil at HHS may be a blessing in disguise

    Muhamad Aly Rifai, MD
  • How grief transformed a psychiatrist’s approach to patient care

    Devina Maya Wadhwa, MD
  • Fear of other people’s opinions nearly killed me. Here’s what freed me.

    Jillian Rigert, MD, DMD
  • What independent and locum tenens doctors need to know about fair market value

    Dennis Hursh, Esq
  • How one simple breakfast question can transform patient care

    Dr. Damane Zehra
  • Most Popular

  • Past Week

    • What’s driving medical students away from primary care?

      ​​Vineeth Amba, MPH, Archita Goyal, and Wayne Altman, MD | Education
    • A faster path to becoming a doctor is possible—here’s how

      Ankit Jain | Education
    • Why no medical malpractice firm responded to my scientific protocol

      Howard Smith, MD | Physician
    • Make cognitive testing as routine as a blood pressure check

      Joshua Baker and James Jackson, PsyD | Conditions
    • A world without antidepressants: What could possibly go wrong?

      Tomi Mitchell, MD | Meds
    • Rethinking patient payments: Why billing is the new frontline of patient care [PODCAST]

      The Podcast by KevinMD | Podcast
  • Past 6 Months

    • What’s driving medical students away from primary care?

      ​​Vineeth Amba, MPH, Archita Goyal, and Wayne Altman, MD | Education
    • Internal Medicine 2025: inspiration at the annual meeting

      American College of Physicians | Physician
    • The silent crisis hurting pain patients and their doctors

      Kayvan Haddadan, MD | Physician
    • What happened to real care in health care?

      Christopher H. Foster, PhD, MPA | Policy
    • Are quotas a solution to physician shortages?

      Jacob Murphy | Education
    • How to build a culture where physicians feel valued [PODCAST]

      The Podcast by KevinMD | Podcast
  • Recent Posts

    • Rethinking patient payments: Why billing is the new frontline of patient care [PODCAST]

      The Podcast by KevinMD | Podcast
    • The dreaded question: Do you have boys or girls?

      Pamela Adelstein, MD | Physician
    • Make cognitive testing as routine as a blood pressure check

      Joshua Baker and James Jackson, PsyD | Conditions
    • Reimagining diabetes care with nutrition, not prescriptions

      William Hsu, MD | Conditions
    • Why funding cuts to academic medical centers impact all of us [PODCAST]

      The Podcast by KevinMD | Podcast
    • What’s driving medical students away from primary care?

      ​​Vineeth Amba, MPH, Archita Goyal, and Wayne Altman, MD | Education

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

View 1 Comments >

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

ADVERTISEMENT

ADVERTISEMENT

ADVERTISEMENT

  • Most Popular

  • Past Week

    • What’s driving medical students away from primary care?

      ​​Vineeth Amba, MPH, Archita Goyal, and Wayne Altman, MD | Education
    • A faster path to becoming a doctor is possible—here’s how

      Ankit Jain | Education
    • Why no medical malpractice firm responded to my scientific protocol

      Howard Smith, MD | Physician
    • Make cognitive testing as routine as a blood pressure check

      Joshua Baker and James Jackson, PsyD | Conditions
    • A world without antidepressants: What could possibly go wrong?

      Tomi Mitchell, MD | Meds
    • Rethinking patient payments: Why billing is the new frontline of patient care [PODCAST]

      The Podcast by KevinMD | Podcast
  • Past 6 Months

    • What’s driving medical students away from primary care?

      ​​Vineeth Amba, MPH, Archita Goyal, and Wayne Altman, MD | Education
    • Internal Medicine 2025: inspiration at the annual meeting

      American College of Physicians | Physician
    • The silent crisis hurting pain patients and their doctors

      Kayvan Haddadan, MD | Physician
    • What happened to real care in health care?

      Christopher H. Foster, PhD, MPA | Policy
    • Are quotas a solution to physician shortages?

      Jacob Murphy | Education
    • How to build a culture where physicians feel valued [PODCAST]

      The Podcast by KevinMD | Podcast
  • Recent Posts

    • Rethinking patient payments: Why billing is the new frontline of patient care [PODCAST]

      The Podcast by KevinMD | Podcast
    • The dreaded question: Do you have boys or girls?

      Pamela Adelstein, MD | Physician
    • Make cognitive testing as routine as a blood pressure check

      Joshua Baker and James Jackson, PsyD | Conditions
    • Reimagining diabetes care with nutrition, not prescriptions

      William Hsu, MD | Conditions
    • Why funding cuts to academic medical centers impact all of us [PODCAST]

      The Podcast by KevinMD | Podcast
    • What’s driving medical students away from primary care?

      ​​Vineeth Amba, MPH, Archita Goyal, and Wayne Altman, MD | Education

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Multiple choice tests in our post-truth world
1 comments

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...