Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
KevinMD
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking
KevinMD
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking
  • About KevinMD | Kevin Pho, MD
  • Be heard on social media’s leading physician voice
  • Contact Kevin
  • Discounted enhanced author page
  • DMCA Policy
  • Establishing, Managing, and Protecting Your Online Reputation: A Social Media Guide for Physicians and Medical Practices
  • Group vs. individual disability insurance for doctors: pros and cons
  • KevinMD influencer opportunities
  • Opinion and commentary by KevinMD
  • Physician burnout speakers to keynote your conference
  • Physician Coaching by KevinMD
  • Physician keynote speaker: Kevin Pho, MD
  • Physician Speaking by KevinMD: a boutique speakers bureau
  • Primary care physician in Nashua, NH | Kevin Pho, MD
  • Privacy Policy
  • Recommended services by KevinMD
  • Terms of Use Agreement
  • Thank you for subscribing to KevinMD
  • Thank you for upgrading to the KevinMD enhanced author page
  • The biggest mistake doctors make when purchasing disability insurance
  • The doctor’s guide to disability insurance: short-term vs. long-term
  • The KevinMD ToolKit
  • Upgrade to the KevinMD enhanced author page
  • Why own-occupation disability insurance is a must for doctors

Lowering hallucination results with ChatGPT

Harvey Castro, MD, MBA
Tech
July 14, 2023
Share
Tweet
Share

The advances of AI, specifically models like GPT-4 from OpenAI, have given rise to powerful tools capable of generating human-like text responses. These models are invaluable in myriad contexts, from customer service and support systems to educational tools and content generators. However, these capabilities also present unique challenges, including the generation of ‘hallucination’ results. In AI, hallucinations refer to instances when the model provides information that, although plausible, is not based on fact.

This article outlines strategies for mitigating hallucinations when interacting with GPT-4, ensuring the outputs are grounded in fact and provide reliable information.

Implementing the “I do not know” prompt

Hallucinations generally occur when the AI model attempts to generate a response, regardless of whether it has the necessary knowledge. To tackle this, programming the model to produce an “I do not know” output when uncertain can be a practical solution.

Take an example from a customer service setting where the AI model might be asked about a product feature it does not know. Instead of the AI creating a false, ‘hallucinated’ feature, programming a threshold of uncertainty can lead the model to respond with “I do not know.” This could prompt the user to provide more context or ask another question the model can answer accurately.

Requesting references

Furthermore, encouraging the model to provide references for its outputs adds another layer of reliability. For instance, if an AI model is used in an educational setting to teach history, it might provide information about a specific event. However, without a reference, it’s hard to judge if the information is a hallucination or factual. By asking for sources or references, users can cross-verify the facts themselves.

Adding a layer of tools like Perplexity.ai to this approach can provide additional security. Perplexity.ai is a state-of-the-art AI platform equipped with several features to improve the reliability of AI models. Its ability to provide references for the information generated by AI is instrumental in combating hallucinations.

Consider a scenario where an AI is used to draft content on a complex topic like quantum physics. By integrating Perplexity.ai, users can verify the technical information provided by the AI and have a set of resources to delve deeper into the subject.

Conclusion

While AI language models like GPT-4 are shaping up as potent tools, mitigating potential issues such as hallucinations is crucial. Implementing an “I do not know” prompt, asking for references, and using innovative tools like Perplexity.ai to verify those references are strategies that can significantly improve the accuracy and reliability of these models.

As we step further into an AI-driven era, integrating such strategies will enhance the efficacy of these tools and foster a sense of trust among the users, making these models a reliable resource for future applications.

Harvey Castro is a physician, health care consultant, and serial entrepreneur with extensive experience in the health care industry. He can be reached on his website, harveycastromd.info, Twitter @HarveycastroMD, Facebook, Instagram, and YouTube. He is the author of Bing Copilot and Other LLM: Revolutionizing Healthcare With AI, Solving Infamous Cases with Artificial Intelligence, The AI-Driven Entrepreneur: Unlocking Entrepreneurial Success with Artificial Intelligence Strategies and Insights, ChatGPT and Healthcare: The Key To The New Future of Medicine, ChatGPT and Healthcare: Unlocking The Potential Of Patient Empowerment, Revolutionize Your Health and Fitness with ChatGPT’s Modern Weight Loss Hacks, and Success Reinvention.

Prev

Food allergies are not preferences. Let’s start treating them that way.

July 14, 2023 Kevin 0
…
Next

On Juneteenth I learned the ugly truth of my new hometown. It restored my faith in humanity.                        

July 14, 2023 Kevin 1
…

Tagged as: Health IT

< Previous Post
Food allergies are not preferences. Let’s start treating them that way.
Next Post >
On Juneteenth I learned the ugly truth of my new hometown. It restored my faith in humanity.                        

ADVERTISEMENT

More by Harvey Castro, MD, MBA

  • AI in clinical documentation: Who is liable for medical errors?

    Harvey Castro, MD, MBA
  • What got you here won’t get you there: a physician’s guide to leadership

    Harvey Castro, MD, MBA
  • In the age of AI, what makes a physician REAL?

    Harvey Castro, MD, MBA

Related Posts

  • Are negative news cycles and social media injurious to our health?

    Rabia Jalal, MD
  • How social media can help or hurt your health care career

    Health eCareers
  • Sharing mental health issues on social media

    Tarena Lofton
  • 3 ways to advance the credibility of online health information

    Robert Pearl, MD
  • Digital health equity is an emerging gap in health

    Joshua W. Elder, MD, MPH and Tamara Scott
  • Improve mental health by improving how we finance health care

    Steven Siegel, MD, PhD

More in Tech

  • Severe note bloat is fueling dangerous physician burnout

    Brian Hudes, MD
  • Why clinical listening skills outpace artificial intelligence

    Ryan Egeland, MD, PhD
  • Understanding Generation 2 patient engagement platforms

    Kevin J. Campbell, MD
  • Artificial intelligence in surgery: Balancing precision with clinical wisdom

    Anastasios Papadonikolakis, MD, PhD
  • The real problem with AI in medicine and drug development

    Jarelis Cabrera
  • Using persuasive technologies in value-based health care

    Olumuyiwa Bamgbade, MD
  • Most Popular

  • Past Week

    • Why clinical listening skills outpace artificial intelligence

      Ryan Egeland, MD, PhD | Tech
    • Why Florida physician background checks are driving doctors away

      Tamzin A. Rosenwasser, MD | Physician
    • The hidden clinical cost of HCC coding in primary care

      Jeffrey H. Millstein, MD | Physician
    • Living with numbness after mastectomy: the unseen impact on survivorship

      Emily Hansen | Conditions
    • How the opioid superagonist DFNZ challenges pain medicine

      Olumuyiwa Bamgbade, MD | Meds
    • A physician’s poem on burnout and end-of-life care

      Nisha Punatar, MD | Physician
  • Past 6 Months

    • Politics and fear have replaced science in U.S. pain management [PODCAST]

      The Podcast by KevinMD | Podcast
    • The controversy over Maintenance of Certification for grandfathered physicians

      Bernard Leo Remakus, MD | Physician
    • Why clinicians fail at writing expert reports

      Tracy Liberatore, Esq, PA | Conditions
    • Evidence-based medicine vs. clinical judgment: a medical student’s perspective

      Jay Pendyala | Education
    • When side effects are actually a cry for help with medication costs

      Shuchita Gupta, MD | Physician
    • The hidden math behind physician hiring costs and recruitment

      Timothy Lesaca, MD | Physician
  • Recent Posts

    • Unrecognized depression is a hidden crisis in medicine

      Francisco M. Torres, MD | Conditions
    • How weight-loss injections are changing obesity treatment

      Mani Habibi, MD | Conditions
    • Severe note bloat is fueling dangerous physician burnout

      Brian Hudes, MD | Tech
    • Why self-care alone cannot cure systemic nursing burnout

      Anonymous | Conditions
    • How physician financial autonomy cures physician burnout

      Tonya Kuhn, MD | Finance
    • Safety-net dentistry restores human dignity for patients recovering from severe addiction [PODCAST]

      The Podcast by KevinMD | Podcast

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

Leave a Comment

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

  • Most Popular

  • Past Week

    • Why clinical listening skills outpace artificial intelligence

      Ryan Egeland, MD, PhD | Tech
    • Why Florida physician background checks are driving doctors away

      Tamzin A. Rosenwasser, MD | Physician
    • The hidden clinical cost of HCC coding in primary care

      Jeffrey H. Millstein, MD | Physician
    • Living with numbness after mastectomy: the unseen impact on survivorship

      Emily Hansen | Conditions
    • How the opioid superagonist DFNZ challenges pain medicine

      Olumuyiwa Bamgbade, MD | Meds
    • A physician’s poem on burnout and end-of-life care

      Nisha Punatar, MD | Physician
  • Past 6 Months

    • Politics and fear have replaced science in U.S. pain management [PODCAST]

      The Podcast by KevinMD | Podcast
    • The controversy over Maintenance of Certification for grandfathered physicians

      Bernard Leo Remakus, MD | Physician
    • Why clinicians fail at writing expert reports

      Tracy Liberatore, Esq, PA | Conditions
    • Evidence-based medicine vs. clinical judgment: a medical student’s perspective

      Jay Pendyala | Education
    • When side effects are actually a cry for help with medication costs

      Shuchita Gupta, MD | Physician
    • The hidden math behind physician hiring costs and recruitment

      Timothy Lesaca, MD | Physician
  • Recent Posts

    • Unrecognized depression is a hidden crisis in medicine

      Francisco M. Torres, MD | Conditions
    • How weight-loss injections are changing obesity treatment

      Mani Habibi, MD | Conditions
    • Severe note bloat is fueling dangerous physician burnout

      Brian Hudes, MD | Tech
    • Why self-care alone cannot cure systemic nursing burnout

      Anonymous | Conditions
    • How physician financial autonomy cures physician burnout

      Tonya Kuhn, MD | Finance
    • Safety-net dentistry restores human dignity for patients recovering from severe addiction [PODCAST]

      The Podcast by KevinMD | Podcast

MedPage Today Professional

An Everyday Health Property Medpage Today

Copyright © 2026 KevinMD.com | Powered by Astra WordPress Theme

  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Leave a Comment

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...