Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

Tests in medicine and public schools: What do they really measure?

Shirie Leng, MD
Physician
May 10, 2015
Share
Tweet
Share

Humans are social creatures who naturally evaluate where they stand in relation to those around them. I have no idea how this evaluation process evolved, but at some point we noticed that some cavemen brought more food to the cave than others. The idea was born that some people are better hunters than others. We’ve been trying to decide who is “better” ever since.

The origin of the word “test” comes from Middle English, and referred to a vessel in which metals were assayed. That is, the test determined what kind of metal was present in the vessel. So a test functioned as an identifier, similar to the way certain medical tests identify specific bacteria. Today most people, when they hear they are being tested, don’t think about the test as just a source of information. People think of testing in terms of evaluation or comparison, a judgement about some aspect of their knowledge or abilities. Someone is better, and someone else is worse.

Here is how Merriam-Webster defines test:

  1. A critical examination, observation, or evaluation.
  2. The procedure of submitting a statement to such conditions or operations as will lead to its proof or disproof or to its acceptance or rejection.
  3. A basis for evaluation.
  4. An ordeal or oath required as proof of conformity with a set of beliefs.
  5. A procedure, reaction, or reagent used to identify or characterize a substance or constituent.
  6. Something (as a series of questions or exercises) for measuring the skill, knowledge, intelligence, capacities, or aptitudes of an individual or group.

Notice the terms “critical,” “ordeal,” “measuring,” “evaluation.”

We have tests for everything. And people are getting sick of tests. Observe the growing backlash against public school testing in New York. Observe the questions arising about medical testing. Observe the pushback from physicians over maintenance of certification exams.

Some tests are good, right? A blood test to identify HIV is good. Quizzing yourself after reading a difficult passage in a textbook is a good test. Covering up the multiplication tables and seeing how much you can do by memory is a good test. Testing the gem in your engagement ring to make sure it’s diamond and not cubic zirconium is a good test. What makes a good test? The Center for Public Education says that test should be “valid, reliable, and free of cultural bias.” Essentially, a good test reliably measures what you want to measure, and, presumably, doesn’t measure what you don’t want to measure.

Let’s take an example. The PSA test evaluates the blood for a prostate-specific antigen that, in high amounts, can be an indicator of prostate cancer. So it measures PSA. That’s all it does. It does not measure how much time a man has left, or mortality rate, or rate of prostate cancer growth, or what the man will eventually die of. In short, it gives you a number that you can’t use. People think a PSA will tell you if you will die of prostate cancer. For that, you’d need a good test. Like a crystal ball.

Here’s another example. Common Core tests kids as early as third grade. The problem with these tests is not that you don’t get useful information. It is that the information you get is not what you want to measure. The test is supposed to measure knowledge but instead tests memorization. It is supposed to measure learning but measures test-taking ability. And actually it isn’t supposed to measure knowledge or learning, but teacher quality. But the test is not administered to teachers, so the test not only doesn’t measure what you want it to but tests the wrong subjects. The result is that students and parents think the test measures the intellect and worth of the student, and school districts think the test measures the intellect and worth of the teacher.

The same problems exist for the maintenance of certification (MOC) exams in anesthesia and other specialties. The tests are time-consuming and expensive and measure memorization and test-taking skills that have nothing to do with quality care.

By some unbelievable miracle, the American Board of Anesthesiology has just announced that they are getting rid of the MOC tests, largely in response to vocal backlash by physicians. Hopefully, a similar outcry from a growing number of parents can effect a similar change in the public schools. It would take a miracle.

Shirie Leng, a former nurse, is an anesthesiologist who blogs at medicine for real.

Prev

Grandparents who spend their old age raising their grandchildren

May 10, 2015 Kevin 0
…
Next

Why should doctors use Twitter?

May 10, 2015 Kevin 1
…

Tagged as: Primary Care, Surgery

Post navigation

< Previous Post
Grandparents who spend their old age raising their grandchildren
Next Post >
Why should doctors use Twitter?

ADVERTISEMENT

ADVERTISEMENT

ADVERTISEMENT

More by Shirie Leng, MD

  • The choice between medicine and nursing

    Shirie Leng, MD
  • New technology might help us become more empathetic to others’ suffering

    Shirie Leng, MD
  • Does practice really make perfect?

    Shirie Leng, MD

More in Physician

  • Why the physician shortage may be our last line of defense

    Yuri Aronov, MD
  • 5 years later: Doctors reveal the untold truths of COVID-19

    Arthur Lazarus, MD, MBA
  • The hidden cost of health care: burnout, disillusionment, and systemic betrayal

    Nivedita U. Jerath, MD
  • Why this doctor hid her story for a decade

    Diane W. Shannon, MD, MPH
  • When errors of nature are treated as medical negligence

    Howard Smith, MD
  • The hidden chains holding doctors back

    Neil Baum, MD
  • Most Popular

  • Past Week

    • The silent toll of ICE raids on U.S. patient care

      Carlin Lockwood | Policy
    • Addressing the physician shortage: How AI can help, not replace

      Amelia Mercado | Tech
    • Why medical students are trading empathy for publications

      Vijay Rajput, MD | Education
    • Why does rifaximin cost 95 percent more in the U.S. than in Asia?

      Jai Kumar, MD, Brian Nohomovich, DO, PhD and Leonid Shamban, DO | Meds
    • Why physicians deserve more than an oxygen mask

      Jessie Mahoney, MD | Physician
    • Avarie’s story: Confronting the deadly gaps in food allergy education and emergency response [PODCAST]

      The Podcast by KevinMD | Podcast
  • Past 6 Months

    • What’s driving medical students away from primary care?

      ​​Vineeth Amba, MPH, Archita Goyal, and Wayne Altman, MD | Education
    • How dismantling DEI endangers the future of medical care

      Shashank Madhu and Christian Tallo | Education
    • How scales of justice saved a doctor-patient relationship

      Neil Baum, MD | Physician
    • A faster path to becoming a doctor is possible—here’s how

      Ankit Jain | Education
    • Make cognitive testing as routine as a blood pressure check

      Joshua Baker and James Jackson, PsyD | Conditions
    • The broken health care system doesn’t have to break you

      Jessie Mahoney, MD | Physician
  • Recent Posts

    • Avarie’s story: Confronting the deadly gaps in food allergy education and emergency response [PODCAST]

      The Podcast by KevinMD | Podcast
    • Why the physician shortage may be our last line of defense

      Yuri Aronov, MD | Physician
    • 5 years later: Doctors reveal the untold truths of COVID-19

      Arthur Lazarus, MD, MBA | Physician
    • The hidden cost of health care: burnout, disillusionment, and systemic betrayal

      Nivedita U. Jerath, MD | Physician
    • What one diagnosis can change: the movement to make dining safer

      Lianne Mandelbaum, PT | Conditions
    • Why this doctor hid her story for a decade

      Diane W. Shannon, MD, MPH | Physician

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

Leave a Comment

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

ADVERTISEMENT

ADVERTISEMENT

ADVERTISEMENT

  • Most Popular

  • Past Week

    • The silent toll of ICE raids on U.S. patient care

      Carlin Lockwood | Policy
    • Addressing the physician shortage: How AI can help, not replace

      Amelia Mercado | Tech
    • Why medical students are trading empathy for publications

      Vijay Rajput, MD | Education
    • Why does rifaximin cost 95 percent more in the U.S. than in Asia?

      Jai Kumar, MD, Brian Nohomovich, DO, PhD and Leonid Shamban, DO | Meds
    • Why physicians deserve more than an oxygen mask

      Jessie Mahoney, MD | Physician
    • Avarie’s story: Confronting the deadly gaps in food allergy education and emergency response [PODCAST]

      The Podcast by KevinMD | Podcast
  • Past 6 Months

    • What’s driving medical students away from primary care?

      ​​Vineeth Amba, MPH, Archita Goyal, and Wayne Altman, MD | Education
    • How dismantling DEI endangers the future of medical care

      Shashank Madhu and Christian Tallo | Education
    • How scales of justice saved a doctor-patient relationship

      Neil Baum, MD | Physician
    • A faster path to becoming a doctor is possible—here’s how

      Ankit Jain | Education
    • Make cognitive testing as routine as a blood pressure check

      Joshua Baker and James Jackson, PsyD | Conditions
    • The broken health care system doesn’t have to break you

      Jessie Mahoney, MD | Physician
  • Recent Posts

    • Avarie’s story: Confronting the deadly gaps in food allergy education and emergency response [PODCAST]

      The Podcast by KevinMD | Podcast
    • Why the physician shortage may be our last line of defense

      Yuri Aronov, MD | Physician
    • 5 years later: Doctors reveal the untold truths of COVID-19

      Arthur Lazarus, MD, MBA | Physician
    • The hidden cost of health care: burnout, disillusionment, and systemic betrayal

      Nivedita U. Jerath, MD | Physician
    • What one diagnosis can change: the movement to make dining safer

      Lianne Mandelbaum, PT | Conditions
    • Why this doctor hid her story for a decade

      Diane W. Shannon, MD, MPH | Physician

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Leave a Comment

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...