Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

Lowering hallucination results with ChatGPT

Harvey Castro, MD, MBA
Tech
July 14, 2023
Share
Tweet
Share

The advances of AI, specifically models like GPT-4 from OpenAI, have given rise to powerful tools capable of generating human-like text responses. These models are invaluable in myriad contexts, from customer service and support systems to educational tools and content generators. However, these capabilities also present unique challenges, including the generation of ‘hallucination’ results. In AI, hallucinations refer to instances when the model provides information that, although plausible, is not based on fact.

This article outlines strategies for mitigating hallucinations when interacting with GPT-4, ensuring the outputs are grounded in fact and provide reliable information.

Implementing the “I do not know” prompt

Hallucinations generally occur when the AI model attempts to generate a response, regardless of whether it has the necessary knowledge. To tackle this, programming the model to produce an “I do not know” output when uncertain can be a practical solution.

Take an example from a customer service setting where the AI model might be asked about a product feature it does not know. Instead of the AI creating a false, ‘hallucinated’ feature, programming a threshold of uncertainty can lead the model to respond with “I do not know.” This could prompt the user to provide more context or ask another question the model can answer accurately.

Requesting references

Furthermore, encouraging the model to provide references for its outputs adds another layer of reliability. For instance, if an AI model is used in an educational setting to teach history, it might provide information about a specific event. However, without a reference, it’s hard to judge if the information is a hallucination or factual. By asking for sources or references, users can cross-verify the facts themselves.

Adding a layer of tools like Perplexity.ai to this approach can provide additional security. Perplexity.ai is a state-of-the-art AI platform equipped with several features to improve the reliability of AI models. Its ability to provide references for the information generated by AI is instrumental in combating hallucinations.

Consider a scenario where an AI is used to draft content on a complex topic like quantum physics. By integrating Perplexity.ai, users can verify the technical information provided by the AI and have a set of resources to delve deeper into the subject.

Conclusion

While AI language models like GPT-4 are shaping up as potent tools, mitigating potential issues such as hallucinations is crucial. Implementing an “I do not know” prompt, asking for references, and using innovative tools like Perplexity.ai to verify those references are strategies that can significantly improve the accuracy and reliability of these models.

As we step further into an AI-driven era, integrating such strategies will enhance the efficacy of these tools and foster a sense of trust among the users, making these models a reliable resource for future applications.

Harvey Castro is a physician, health care consultant, and serial entrepreneur with extensive experience in the health care industry. He can be reached on his website, harveycastromd.info, Twitter @HarveycastroMD, Facebook, Instagram, and YouTube. He is the author of Bing Copilot and Other LLM: Revolutionizing Healthcare With AI, Solving Infamous Cases with Artificial Intelligence, The AI-Driven Entrepreneur: Unlocking Entrepreneurial Success with Artificial Intelligence Strategies and Insights, ChatGPT and Healthcare: The Key To The New Future of Medicine, ChatGPT and Healthcare: Unlocking The Potential Of Patient Empowerment, Revolutionize Your Health and Fitness with ChatGPT’s Modern Weight Loss Hacks, and Success Reinvention.

Prev

Food allergies are not preferences. Let’s start treating them that way.

July 14, 2023 Kevin 0
…
Next

On Juneteenth I learned the ugly truth of my new hometown. It restored my faith in humanity.                        

July 14, 2023 Kevin 1
…

Tagged as: Health IT

Post navigation

< Previous Post
Food allergies are not preferences. Let’s start treating them that way.
Next Post >
On Juneteenth I learned the ugly truth of my new hometown. It restored my faith in humanity.                        

ADVERTISEMENT

More by Harvey Castro, MD, MBA

  • Why Grok 4 could be the next leap for HIPAA-compliant clinical AI

    Harvey Castro, MD, MBA
  • Generative AI 2025: a 20-minute cheat sheet for busy clinicians

    Harvey Castro, MD, MBA
  • AI and humanity in health care: Preserving what makes us human

    Harvey Castro, MD, MBA

Related Posts

  • Are negative news cycles and social media injurious to our health?

    Rabia Jalal, MD
  • How social media can help or hurt your health care career

    Health eCareers
  • Sharing mental health issues on social media

    Tarena Lofton
  • 3 ways to advance the credibility of online health information

    Robert Pearl, MD
  • Digital health equity is an emerging gap in health

    Joshua W. Elder, MD, MPH and Tamara Scott
  • Improve mental health by improving how we finance health care

    Steven Siegel, MD, PhD

More in Tech

  • Why Grok 4 could be the next leap for HIPAA-compliant clinical AI

    Harvey Castro, MD, MBA
  • AI is already replacing doctors—just not how you think

    Bhargav Raman, MD, MBA
  • A mind to guide the machine: Why physicians must help shape artificial intelligence in medicine

    Shanice Spence-Miller, MD
  • How digital tools are reshaping the doctor-patient relationship

    Vineet Vishwanath
  • The promise and perils of AI in health care: Why we need better testing standards

    Max Rollwage, PhD
  • 3 tips for using AI medical scribes to save time charting

    Erica Dorn, FNP
  • Most Popular

  • Past Week

    • Forced voicemail and diagnosis codes are endangering patient access to medications

      Arthur Lazarus, MD, MBA | Meds
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy
    • America’s ER crisis: Why the system is collapsing from within

      Kristen Cline, BSN, RN | Conditions
    • Why timing, not surgery, determines patient survival

      Michael Karch, MD | Conditions
    • How early meetings and after-hours events penalize physician-mothers

      Samira Jeimy, MD, PhD and Menaka Pai, MD | Physician
    • FDA delays could end vital treatment for rare disease patients

      GJ van Londen, MD | Meds
  • Past 6 Months

    • Forced voicemail and diagnosis codes are endangering patient access to medications

      Arthur Lazarus, MD, MBA | Meds
    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
    • Why are medical students turning away from primary care? [PODCAST]

      The Podcast by KevinMD | Podcast
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy
    • Why “do no harm” might be harming modern medicine

      Sabooh S. Mubbashar, MD | Physician
    • Here’s what providers really need in a modern EHR

      Laura Kohlhagen, MD, MBA | Tech
  • Recent Posts

    • The truth about perfection and identity in health care

      Ryan Nadelson, MD | Physician
    • Civil discourse as a leadership competency: the case for curiosity in medicine

      All Levels Leadership | Physician
    • Healing beyond the surface: Why proper chronic wound care matters

      Alvin May, MD | Conditions
    • Why specialist pain clinics and addiction treatment services require strong primary care

      Olumuyiwa Bamgbade, MD | Conditions
    • Dear July intern: It’s normal to feel clueless—here’s what matters

      Tomi Mitchell, MD | Education
    • Who gets to be well in America: Immigrant health is on the line

      Joshua Vasquez, MD | Policy

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

Leave a Comment

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

  • Most Popular

  • Past Week

    • Forced voicemail and diagnosis codes are endangering patient access to medications

      Arthur Lazarus, MD, MBA | Meds
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy
    • America’s ER crisis: Why the system is collapsing from within

      Kristen Cline, BSN, RN | Conditions
    • Why timing, not surgery, determines patient survival

      Michael Karch, MD | Conditions
    • How early meetings and after-hours events penalize physician-mothers

      Samira Jeimy, MD, PhD and Menaka Pai, MD | Physician
    • FDA delays could end vital treatment for rare disease patients

      GJ van Londen, MD | Meds
  • Past 6 Months

    • Forced voicemail and diagnosis codes are endangering patient access to medications

      Arthur Lazarus, MD, MBA | Meds
    • How President Biden’s cognitive health shapes political and legal trust

      Muhamad Aly Rifai, MD | Conditions
    • Why are medical students turning away from primary care? [PODCAST]

      The Podcast by KevinMD | Podcast
    • The One Big Beautiful Bill and the fragile heart of rural health care

      Holland Haynie, MD | Policy
    • Why “do no harm” might be harming modern medicine

      Sabooh S. Mubbashar, MD | Physician
    • Here’s what providers really need in a modern EHR

      Laura Kohlhagen, MD, MBA | Tech
  • Recent Posts

    • The truth about perfection and identity in health care

      Ryan Nadelson, MD | Physician
    • Civil discourse as a leadership competency: the case for curiosity in medicine

      All Levels Leadership | Physician
    • Healing beyond the surface: Why proper chronic wound care matters

      Alvin May, MD | Conditions
    • Why specialist pain clinics and addiction treatment services require strong primary care

      Olumuyiwa Bamgbade, MD | Conditions
    • Dear July intern: It’s normal to feel clueless—here’s what matters

      Tomi Mitchell, MD | Education
    • Who gets to be well in America: Immigrant health is on the line

      Joshua Vasquez, MD | Policy

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Leave a Comment

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...