Skip to content
  • About
  • Contact
  • Contribute
  • What Physicians Say
  • My Book
  • Careers
  • Podcast
  • Speaking
KevinMD.com — Social media's leading physician voice
  • All
  • Physician
  • Burnout
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • All
  • Physician
  • Burnout
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
    • All
    • Physician
    • Burnout
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • About
    • Contact
    • Contribute
    • What Physicians Say
    • My Book
    • Careers
    • Podcast
    • Speaking
KevinMD.com — Social media's leading physician voice
  • All
  • Physician
  • Burnout
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
    • All
    • Physician
    • Burnout
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • About
    • Contact
    • Contribute
    • What Physicians Say
    • My Book
    • Careers
    • Podcast
    • Speaking
  • About Kevin Pho, MD, Founder of KevinMD
  • Aging and dementia: what physicians say, in their own words
  • Artificial intelligence: what physicians say, in their own words
  • Be heard on social media’s leading physician voice
  • Cancer: what physicians say, in their own words
  • Children’s health: what pediatricians say, in their own words
  • Contact Kevin
  • COVID-19: what physicians wrote as it happened
  • Custom enhanced author page pricing
  • Diabetes and obesity: what physicians say, in their own words
  • Direct primary care: what physicians say, in their own words
  • DMCA Policy
  • End of life: what physicians say, in their own words
  • Establishing, Managing, and Protecting Your Online Reputation: A Social Media Guide for Physicians and Medical Practices
  • GLP-1 drugs: what physicians say about Ozempic and its successors, in their own words
  • Heart disease: what physicians say, in their own words
  • Immigration and medicine: what physicians say about immigrant doctors and immigrant patients, in their own words
  • KevinMD influencer opportunities
  • Medical errors: what physicians say, in their own words
  • Medical ethics: what physicians say, in their own words
  • Medical malpractice: what physicians say, in their own words
  • Medical school: what students and physicians say, in their own words
  • Mental health: what psychiatrists and physicians say, in their own words
  • Nursing: what nurses and physicians say, in their own words
  • Opinion and commentary by KevinMD
  • Opioids: what physicians and pain patients say, in their own words
  • Physician burnout speakers to keynote your conference
  • Physician burnout: what physicians say, in their own words
  • Physician Coaching by KevinMD
  • Physician keynote speaker: Kevin Pho, MD
  • Physician personal finance: what physicians say about their own money, in their own words
  • Physician Speaking by KevinMD: a boutique speakers bureau
  • Physician suicide: what physicians say, in their own words
  • Physicians and administrators: what physicians say about who runs medicine, in their own words
  • Primary care physician in Nashua, NH | Kevin Pho, MD
  • Primary care: what physicians say, in their own words
  • Prior authorization: what physicians say, in their own words
  • Privacy Policy
  • Private equity and corporate medicine: what physicians say, in their own words
  • Race and medicine: what physicians say, in their own words
  • Recommended services by KevinMD
  • Residency: what residents and attendings say, in their own words
  • Scope of practice: what physicians, nurse practitioners, and PAs say, in their own words
  • Subscribe to the KevinMD enhanced author page
  • Subscribe to the newsletter
  • Surgeons and surgery: what surgeons say, in their own words
  • Take-home messages: what physicians say when asked to leave one
  • Terms of Use Agreement
  • Thank you for subscribing to KevinMD
  • Thank you for upgrading to the KevinMD enhanced author page
  • The electronic health record: what physicians say, in their own words
  • Vaccines: what physicians say, in their own words
  • Violence against health care workers: what physicians and nurses say, in their own words
  • What physicians say: the KevinMD records
  • Women in medicine: what women physicians say, in their own words
  • Women’s health: what physicians say, in their own words

How big data will shape the future of medicine

Akhilesh Pathipati, MD
Health Policy
May 24, 2017
Share
Tweet
Share

In any educational environment, there’s a set of buzzwords that create a common vocabulary. Medical students constantly hear about “bench-to-bedside research,” “evidence-based medicine,” and “compassionate care.” Meanwhile, business school students can’t stop talking about “aligning objectives,” “disruptive innovation,” and of course, “synergy.”

One of the most frequently used phrases in both schools is “big data.” The idea is that with bigger, faster computers and new analytical techniques, we can now sift through vast amounts of information to generate new insights.

There are countless applications. For example, electronic health records have led to the digitization of health data, and clinical researchers are trying to use this information to identify traits that predict disease, response to treatment, and a host of other variables. The same techniques can be used on corporate datasets to link business decisions (such as pricing) to consumer behavior.

Data analytics is therefore held up as a panacea for complex problem-solving in both the medical and business worlds.

The shared excitement has led me to a few reflections about big data. First, it highlights that many decisions in both business and medicine are currently based on instinct rather than evidence. While leaders do their best to support reasoning with data, sometimes data isn’t available.

A recent report by PricewaterhouseCoopers found that senior executives primarily rely on intuition and experience to make decisions. Similarly, companies often launch products based on feedback from a few people in a focus group because they cannot test a larger scale response.

Medicine has done a better job using data and creating evidence-based guidelines based on randomized controlled trials (RCTs). But when treating patients, doctors must frequently fall back on clinical judgment derived from anecdotal experience as well. Indeed, a study published in PLOS Medicine found that just 31 percent of cardiovascular risk management recommendations were supported by high-quality RCTs.

Big data is exciting because it can make decision-making more rigorous. With enough historical information, it will be possible to build models that can predict future outcomes.

With that said, my second realization was that we need to be cautious with insights from large datasets. In any statistics class, the first lesson includes some variant of the statement, “correlation does not equal causation.” That statement doesn’t become any less true just because the data is “big.”

Predictive models are useful tools but they don’t always work. Google Flu Trends offers an instructive example. In 2009, Google published a letter in Nature announcing that they had developed an algorithm that could track flu outbreaks based on an enormous sample of Google searches. Their approach was remarkably accurate and much faster than the CDC, which tracked flu outbreaks based on reports from doctors.

Commentators hailed the tool as a breakthrough in big data and a sign that the future had arrived. But within a few years, it no longer worked. The search terms that had been associated with flu outbreaks didn’t correlate anymore. By 2015, Google Flu Trends shut down. This quickly led to proclamations about the failings of big data.

Examples like this don’t prove that big data is a failure. Instead, they demonstrate the importance of developing skills to interpret data. There is a temptation to believe that new statistical tools can be implemented in a black box (by companies like Google) and that we can simply use whatever comes out of it.

I expect that mentality to change. Whether it’s a doctor or a CEO, decision-makers need to adapt to the growing role of data. Analytical techniques are only useful when they are properly applied, meaning we need to understand their underlying assumptions and think carefully about what to do with the results.

ADVERTISEMENT

Fortunately, my experience suggests both business and medical schools are preparing students for this reality. While we’re still in the early days of the big data revolution, there is little question that it will shape the future of medicine, business, and more.

Akhilesh Pathipati is a medical student who blogs at Scope, where this article originally appeared.

Image credit: Shutterstock.com

Prev

Do expired EpiPens still work?

May 24, 2017 Kevin 0
…
Next

A physician broke down walls, or so she thought

May 25, 2017 Kevin 4
…

Tagged as: Health Policy and Public Health

< Previous Post
Do expired EpiPens still work?
Next Post >
A physician broke down walls, or so she thought

 

ADVERTISEMENT

More by Akhilesh Pathipati, MD

  • The rewarding and grueling process of residency application

    Akhilesh Pathipati, MD
  • Medical schools should improve long-term career counseling

    Akhilesh Pathipati, MD
  • A graduating medical student reflects on the last few years

    Akhilesh Pathipati, MD

Related Posts

  • How social media can advance humanism in medicine

    Pooja Lakshmin, MD
  • Why environmental justice is integral to the future of medicine

    Mehtab Sal and Olivia Glatt
  • Take politics out of science and medicine

    Anonymous
  • 5 reasons to get involved in organized medicine

    Frances Mei Hardin, MD
  • The difference between learning medicine and doing medicine

    Steven Zhang, MD
  • Medicine is failing rural Americans

    Michael McCarthy

More in Health Policy

  • The next child

    Medicaid managed care and the case for mutual stewardship

    Steven Merahn, MD
  • How to build a dementia care pathway, not a referral sheet

    Gerald Kuo
  • AI in prior authorization: 3 contract questions for 2027

    Matt Hasan, PhD
  • Private equity in medicine did not kill private practice

    Brian Hudes, MD
  • Why are fewer family physicians delivering babies?

    Frista Gradica
  • Local news and public health: the segment viewers missed

    Ronald L. Lindsay, MD
  • Most Popular

  • Past Week

    • Retirement isn’t the end of medicine, it’s a second act [PODCAST]

      The Podcast by KevinMD | Podcast
    • The conflict of interest that discloses as nothing

      Martha Rosenberg | Medications
    • Surgical judgment: the skill no one sees from the gallery

      Mustafa Kemal Çalık, MD | Physician
    • Why haven’t ambient AI scribes boosted productivity?

      Karan Kanwar | Health Technology
    • 3 reforms to counter wellness influencers in practice

      Farid Sabet-Sharghi, MD | Physician
    • Physician well-being is not an individual problem

      Heather Buckley | Conditions and Diseases
  • Past 6 Months

    • Why CDC opioid guidelines get the overdose data wrong

      Richard A. Lawhern, PhD | Conditions and Diseases
    • Retirement isn’t the end of medicine, it’s a second act [PODCAST]

      The Podcast by KevinMD | Podcast
    • Sensory processing in autism and the brain’s volume control

      Josette Pelatan, PhD | Conditions and Diseases
    • What maternity care deserts cost a town

      Manisha Kaliaperumal | Health Policy
    • Why medicine needs a national physician license now

      Vaishali Popat, MD, MPH | Physician
    • A cold cost $945. The cost of primary care is broken.

      Susan Newman, MD | Physician
  • Recent Posts

    • 3 reforms to counter wellness influencers in practice

      Farid Sabet-Sharghi, MD | Physician
    • Shift work and circadian rhythms shape the 24/7 workplace

      Deepak Gupta, MD | Conditions and Diseases
    • Paid for twice

      Physicians paid for G2211 twice. Most never bill it.

      Michael Duben, MD | Physician Finance
    • The next child

      Medicaid managed care and the case for mutual stewardship

      Steven Merahn, MD | Health Policy
    • Choosing a limb lengthening surgeon requires accountability

      Hrayr Basmajian, MD | Physician
    • Cited but never checked

      Why AI crisis advice may fail families facing psychosis

      Nicole Drapeau Gillen | Health Technology

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

View 3 Comments >

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

  • Most Popular

  • Past Week

    • Retirement isn’t the end of medicine, it’s a second act [PODCAST]

      The Podcast by KevinMD | Podcast
    • The conflict of interest that discloses as nothing

      Martha Rosenberg | Medications
    • Surgical judgment: the skill no one sees from the gallery

      Mustafa Kemal Çalık, MD | Physician
    • Why haven’t ambient AI scribes boosted productivity?

      Karan Kanwar | Health Technology
    • 3 reforms to counter wellness influencers in practice

      Farid Sabet-Sharghi, MD | Physician
    • Physician well-being is not an individual problem

      Heather Buckley | Conditions and Diseases
  • Past 6 Months

    • Why CDC opioid guidelines get the overdose data wrong

      Richard A. Lawhern, PhD | Conditions and Diseases
    • Retirement isn’t the end of medicine, it’s a second act [PODCAST]

      The Podcast by KevinMD | Podcast
    • Sensory processing in autism and the brain’s volume control

      Josette Pelatan, PhD | Conditions and Diseases
    • What maternity care deserts cost a town

      Manisha Kaliaperumal | Health Policy
    • Why medicine needs a national physician license now

      Vaishali Popat, MD, MPH | Physician
    • A cold cost $945. The cost of primary care is broken.

      Susan Newman, MD | Physician
  • Recent Posts

    • 3 reforms to counter wellness influencers in practice

      Farid Sabet-Sharghi, MD | Physician
    • Shift work and circadian rhythms shape the 24/7 workplace

      Deepak Gupta, MD | Conditions and Diseases
    • Paid for twice

      Physicians paid for G2211 twice. Most never bill it.

      Michael Duben, MD | Physician Finance
    • The next child

      Medicaid managed care and the case for mutual stewardship

      Steven Merahn, MD | Health Policy
    • Choosing a limb lengthening surgeon requires accountability

      Hrayr Basmajian, MD | Physician
    • Cited but never checked

      Why AI crisis advice may fail families facing psychosis

      Nicole Drapeau Gillen | Health Technology

Copyright © 2026 KevinMD.com | Powered by Astra WordPress Theme

  • Terms of Use Agreement
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

How big data will shape the future of medicine
3 comments

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...