Skip to content
  • About
  • Contact
  • Contribute
  • What Physicians Say
  • My Book
  • Careers
  • Podcast
  • Speaking
KevinMD.com — Social media's leading physician voice
  • All
  • Physician
  • Burnout
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • All
  • Physician
  • Burnout
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
    • All
    • Physician
    • Burnout
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • About
    • Contact
    • Contribute
    • What Physicians Say
    • My Book
    • Careers
    • Podcast
    • Speaking
KevinMD.com — Social media's leading physician voice
  • All
  • Physician
  • Burnout
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
    • All
    • Physician
    • Burnout
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • About
    • Contact
    • Contribute
    • What Physicians Say
    • My Book
    • Careers
    • Podcast
    • Speaking
  • About Kevin Pho, MD, Founder of KevinMD
  • Aging and dementia: what physicians say, in their own words
  • Artificial intelligence: what physicians say, in their own words
  • Be heard on social media’s leading physician voice
  • Cancer: what physicians say, in their own words
  • Children’s health: what pediatricians say, in their own words
  • Contact Kevin
  • COVID-19: what physicians wrote as it happened
  • Custom enhanced author page pricing
  • Diabetes and obesity: what physicians say, in their own words
  • Direct primary care: what physicians say, in their own words
  • DMCA Policy
  • End of life: what physicians say, in their own words
  • Establishing, Managing, and Protecting Your Online Reputation: A Social Media Guide for Physicians and Medical Practices
  • GLP-1 drugs: what physicians say about Ozempic and its successors, in their own words
  • Heart disease: what physicians say, in their own words
  • Immigration and medicine: what physicians say about immigrant doctors and immigrant patients, in their own words
  • KevinMD influencer opportunities
  • Medical errors: what physicians say, in their own words
  • Medical ethics: what physicians say, in their own words
  • Medical malpractice: what physicians say, in their own words
  • Medical school: what students and physicians say, in their own words
  • Mental health: what psychiatrists and physicians say, in their own words
  • Nursing: what nurses and physicians say, in their own words
  • Opinion and commentary by KevinMD
  • Opioids: what physicians and pain patients say, in their own words
  • Physician burnout speakers to keynote your conference
  • Physician burnout: what physicians say, in their own words
  • Physician Coaching by KevinMD
  • Physician keynote speaker: Kevin Pho, MD
  • Physician personal finance: what physicians say about their own money, in their own words
  • Physician Speaking by KevinMD: a boutique speakers bureau
  • Physician suicide: what physicians say, in their own words
  • Physicians and administrators: what physicians say about who runs medicine, in their own words
  • Primary care physician in Nashua, NH | Kevin Pho, MD
  • Primary care: what physicians say, in their own words
  • Prior authorization: what physicians say, in their own words
  • Privacy Policy
  • Private equity and corporate medicine: what physicians say, in their own words
  • Race and medicine: what physicians say, in their own words
  • Recommended services by KevinMD
  • Residency: what residents and attendings say, in their own words
  • Scope of practice: what physicians, nurse practitioners, and PAs say, in their own words
  • Subscribe to the KevinMD enhanced author page
  • Subscribe to the newsletter
  • Surgeons and surgery: what surgeons say, in their own words
  • Take-home messages: what physicians say when asked to leave one
  • Terms of Use Agreement
  • Thank you for subscribing to KevinMD
  • Thank you for upgrading to the KevinMD enhanced author page
  • The electronic health record: what physicians say, in their own words
  • Vaccines: what physicians say, in their own words
  • Violence against health care workers: what physicians and nurses say, in their own words
  • What physicians say: the KevinMD records
  • Women in medicine: what women physicians say, in their own words
  • Women’s health: what physicians say, in their own words

Lowering hallucination results with ChatGPT

Harvey Castro, MD, MBA
Health Technology
July 14, 2023
Share
Tweet
Share

The advances of AI, specifically models like GPT-4 from OpenAI, have given rise to powerful tools capable of generating human-like text responses. These models are invaluable in myriad contexts, from customer service and support systems to educational tools and content generators. However, these capabilities also present unique challenges, including the generation of ‘hallucination’ results. In AI, hallucinations refer to instances when the model provides information that, although plausible, is not based on fact.

This article outlines strategies for mitigating hallucinations when interacting with GPT-4, ensuring the outputs are grounded in fact and provide reliable information.

Implementing the “I do not know” prompt

Hallucinations generally occur when the AI model attempts to generate a response, regardless of whether it has the necessary knowledge. To tackle this, programming the model to produce an “I do not know” output when uncertain can be a practical solution.

Take an example from a customer service setting where the AI model might be asked about a product feature it does not know. Instead of the AI creating a false, ‘hallucinated’ feature, programming a threshold of uncertainty can lead the model to respond with “I do not know.” This could prompt the user to provide more context or ask another question the model can answer accurately.

Requesting references

Furthermore, encouraging the model to provide references for its outputs adds another layer of reliability. For instance, if an AI model is used in an educational setting to teach history, it might provide information about a specific event. However, without a reference, it’s hard to judge if the information is a hallucination or factual. By asking for sources or references, users can cross-verify the facts themselves.

Adding a layer of tools like Perplexity.ai to this approach can provide additional security. Perplexity.ai is a state-of-the-art AI platform equipped with several features to improve the reliability of AI models. Its ability to provide references for the information generated by AI is instrumental in combating hallucinations.

Consider a scenario where an AI is used to draft content on a complex topic like quantum physics. By integrating Perplexity.ai, users can verify the technical information provided by the AI and have a set of resources to delve deeper into the subject.

Conclusion

While AI language models like GPT-4 are shaping up as potent tools, mitigating potential issues such as hallucinations is crucial. Implementing an “I do not know” prompt, asking for references, and using innovative tools like Perplexity.ai to verify those references are strategies that can significantly improve the accuracy and reliability of these models.

As we step further into an AI-driven era, integrating such strategies will enhance the efficacy of these tools and foster a sense of trust among the users, making these models a reliable resource for future applications.

Harvey Castro, known as DR GPT™, is an emergency physician, author, keynote speaker, and physician futurist. He is advisor to the CEO of Phantom Space. He writes and speaks about artificial intelligence in health care, digital health, space medicine, and the future of human-centered care. Explore his speaking topics and availability.

He is the author of Bing Copilot and Other LLM: Revolutionizing Healthcare With AI, Solving Infamous Cases with Artificial Intelligence, The AI-Driven Entrepreneur: Unlocking Entrepreneurial Success with Artificial Intelligence Strategies and Insights, ChatGPT and Healthcare: The Key To The New Future of Medicine, ChatGPT and Healthcare: Unlocking The Potential Of Patient Empowerment, Revolutionize Your Health and Fitness with ChatGPT’s Modern Weight Loss Hacks, Success Reinvention, and Apple Vision Healthcare Pioneers: A Community for Professionals & Patients.

He shares updates on LinkedIn, YouTube, Facebook, Instagram, and X. #DRGPT

ADVERTISEMENT

Prev

Food allergies are not preferences. Let’s start treating them that way.

July 14, 2023 Kevin 0
…
Next

On Juneteenth I learned the ugly truth of my new hometown. It restored my faith in humanity.                        

July 14, 2023 Kevin 1
…

Tagged as: Health IT and AI in Medicine

< Previous Post
Food allergies are not preferences. Let’s start treating them that way.
Next Post >
On Juneteenth I learned the ugly truth of my new hometown. It restored my faith in humanity.                        

 

ADVERTISEMENT

More by Harvey Castro, MD, MBA

  • ChatGPT for triage: 5 rules I teach ER residents

    Harvey Castro, MD, MBA
  • Patient trust in AI starts with human accountability

    Harvey Castro, MD, MBA
  • AI strategy for hospitals: the 5 mistakes boards make

    Harvey Castro, MD, MBA

Related Posts

  • Are negative news cycles and social media injurious to our health?

    Rabia Jalal, MD
  • How social media can help or hurt your health care career

    Health eCareers
  • Sharing mental health issues on social media

    Tarena Lofton
  • 3 ways to advance the credibility of online health information

    Robert Pearl, MD
  • Digital health equity is an emerging gap in health

    Joshua W. Elder, MD, MPH and Tamara Scott
  • Improve mental health by improving how we finance health care

    Steven Siegel, MD, PhD

More in Health Technology

  • Cited but never checked

    Why AI crisis advice may fail families facing psychosis

    Nicole Drapeau Gillen
  • How AI phone systems in health care create barriers

    Thuy D. Bui, MD
  • AI data centers and public health demand regulation

    Jacob Player, MD, MPH
  • ChatGPT for triage: 5 rules I teach ER residents

    Harvey Castro, MD, MBA
  • Automation bias in health care can become paternalism

    John Wei, MD
  • 4 workflow fixes that cut physician burnout at the source

    Kevin Halow, MD, MBA
  • Most Popular

  • Past Week

    • Retirement isn’t the end of medicine, it’s a second act [PODCAST]

      The Podcast by KevinMD | Podcast
    • The conflict of interest that discloses as nothing

      Martha Rosenberg | Medications
    • 4 fibromyalgia myths the current evidence doesn’t support

      Kayvan Haddadan, MD | Conditions and Diseases
    • Why exhaustion can make you see things that aren’t there [PODCAST]

      The Podcast by KevinMD | Podcast
    • AI governance in health care has to reach the exam room

      Amanda Heidemann, MD | Health Technology
    • The Pennsylvania measles outbreak and the cost of forgetting

      Christine King, CRNA | Conditions and Diseases
  • Past 6 Months

    • Why CDC opioid guidelines get the overdose data wrong

      Richard A. Lawhern, PhD | Conditions and Diseases
    • Retirement isn’t the end of medicine, it’s a second act [PODCAST]

      The Podcast by KevinMD | Podcast
    • Sensory processing in autism and the brain’s volume control

      Josette Pelatan, PhD | Conditions and Diseases
    • What maternity care deserts cost a town

      Manisha Kaliaperumal | Health Policy
    • Why medicine needs a national physician license now

      Vaishali Popat, MD, MPH | Physician
    • A cold cost $945. The cost of primary care is broken.

      Susan Newman, MD | Physician
  • Recent Posts

    • Why exhaustion can make you see things that aren’t there [PODCAST]

      The Podcast by KevinMD | Podcast
    • 3 reforms to counter wellness influencers in practice

      Farid Sabet-Sharghi, MD | Physician
    • Shift work and circadian rhythms shape the 24/7 workplace

      Deepak Gupta, MD | Conditions and Diseases
    • Paid for twice

      Physicians paid for G2211 twice. Most never bill it.

      Michael Duben, MD | Physician Finance
    • The next child

      Medicaid managed care and the case for mutual stewardship

      Steven Merahn, MD | Health Policy
    • Choosing a limb lengthening surgeon requires accountability

      Hrayr Basmajian, MD | Physician

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

Leave a Comment

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

  • Most Popular

  • Past Week

    • Retirement isn’t the end of medicine, it’s a second act [PODCAST]

      The Podcast by KevinMD | Podcast
    • The conflict of interest that discloses as nothing

      Martha Rosenberg | Medications
    • 4 fibromyalgia myths the current evidence doesn’t support

      Kayvan Haddadan, MD | Conditions and Diseases
    • Why exhaustion can make you see things that aren’t there [PODCAST]

      The Podcast by KevinMD | Podcast
    • AI governance in health care has to reach the exam room

      Amanda Heidemann, MD | Health Technology
    • The Pennsylvania measles outbreak and the cost of forgetting

      Christine King, CRNA | Conditions and Diseases
  • Past 6 Months

    • Why CDC opioid guidelines get the overdose data wrong

      Richard A. Lawhern, PhD | Conditions and Diseases
    • Retirement isn’t the end of medicine, it’s a second act [PODCAST]

      The Podcast by KevinMD | Podcast
    • Sensory processing in autism and the brain’s volume control

      Josette Pelatan, PhD | Conditions and Diseases
    • What maternity care deserts cost a town

      Manisha Kaliaperumal | Health Policy
    • Why medicine needs a national physician license now

      Vaishali Popat, MD, MPH | Physician
    • A cold cost $945. The cost of primary care is broken.

      Susan Newman, MD | Physician
  • Recent Posts

    • Why exhaustion can make you see things that aren’t there [PODCAST]

      The Podcast by KevinMD | Podcast
    • 3 reforms to counter wellness influencers in practice

      Farid Sabet-Sharghi, MD | Physician
    • Shift work and circadian rhythms shape the 24/7 workplace

      Deepak Gupta, MD | Conditions and Diseases
    • Paid for twice

      Physicians paid for G2211 twice. Most never bill it.

      Michael Duben, MD | Physician Finance
    • The next child

      Medicaid managed care and the case for mutual stewardship

      Steven Merahn, MD | Health Policy
    • Choosing a limb lengthening surgeon requires accountability

      Hrayr Basmajian, MD | Physician

Copyright © 2026 KevinMD.com | Powered by Astra WordPress Theme

  • Terms of Use Agreement
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Leave a Comment

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...