Skip to content
  • About
  • Contact
  • Contribute
  • Book
  • Careers
  • Podcast
  • Recommended
  • Speaking
  • All
  • Physician
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • Video
    • All
    • Physician
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • Video
    • About
    • Contact
    • Contribute
    • Book
    • Careers
    • Podcast
    • Recommended
    • Speaking

Lowering hallucination results with ChatGPT

Harvey Castro, MD, MBA
Tech
July 14, 2023
Share
Tweet
Share

The advances of AI, specifically models like GPT-4 from OpenAI, have given rise to powerful tools capable of generating human-like text responses. These models are invaluable in myriad contexts, from customer service and support systems to educational tools and content generators. However, these capabilities also present unique challenges, including the generation of ‘hallucination’ results. In AI, hallucinations refer to instances when the model provides information that, although plausible, is not based on fact.

This article outlines strategies for mitigating hallucinations when interacting with GPT-4, ensuring the outputs are grounded in fact and provide reliable information.

Implementing the “I do not know” prompt

Hallucinations generally occur when the AI model attempts to generate a response, regardless of whether it has the necessary knowledge. To tackle this, programming the model to produce an “I do not know” output when uncertain can be a practical solution.

Take an example from a customer service setting where the AI model might be asked about a product feature it does not know. Instead of the AI creating a false, ‘hallucinated’ feature, programming a threshold of uncertainty can lead the model to respond with “I do not know.” This could prompt the user to provide more context or ask another question the model can answer accurately.

Requesting references

Furthermore, encouraging the model to provide references for its outputs adds another layer of reliability. For instance, if an AI model is used in an educational setting to teach history, it might provide information about a specific event. However, without a reference, it’s hard to judge if the information is a hallucination or factual. By asking for sources or references, users can cross-verify the facts themselves.

Adding a layer of tools like Perplexity.ai to this approach can provide additional security. Perplexity.ai is a state-of-the-art AI platform equipped with several features to improve the reliability of AI models. Its ability to provide references for the information generated by AI is instrumental in combating hallucinations.

Consider a scenario where an AI is used to draft content on a complex topic like quantum physics. By integrating Perplexity.ai, users can verify the technical information provided by the AI and have a set of resources to delve deeper into the subject.

Conclusion

While AI language models like GPT-4 are shaping up as potent tools, mitigating potential issues such as hallucinations is crucial. Implementing an “I do not know” prompt, asking for references, and using innovative tools like Perplexity.ai to verify those references are strategies that can significantly improve the accuracy and reliability of these models.

As we step further into an AI-driven era, integrating such strategies will enhance the efficacy of these tools and foster a sense of trust among the users, making these models a reliable resource for future applications.

Harvey Castro is a physician, health care consultant, and serial entrepreneur with extensive experience in the health care industry. He can be reached on his website, harveycastromd.info, Twitter @HarveycastroMD, Facebook, Instagram, and YouTube. He is the author of Bing Copilot and Other LLM: Revolutionizing Healthcare With AI, Solving Infamous Cases with Artificial Intelligence, The AI-Driven Entrepreneur: Unlocking Entrepreneurial Success with Artificial Intelligence Strategies and Insights, ChatGPT and Healthcare: The Key To The New Future of Medicine, ChatGPT and Healthcare: Unlocking The Potential Of Patient Empowerment, Revolutionize Your Health and Fitness with ChatGPT’s Modern Weight Loss Hacks, and Success Reinvention.

Prev

Food allergies are not preferences. Let’s start treating them that way.

July 14, 2023 Kevin 0
…
Next

On Juneteenth I learned the ugly truth of my new hometown. It restored my faith in humanity.                        

July 14, 2023 Kevin 1
…

Tagged as: Health IT

Post navigation

< Previous Post
Food allergies are not preferences. Let’s start treating them that way.
Next Post >
On Juneteenth I learned the ugly truth of my new hometown. It restored my faith in humanity.                        

ADVERTISEMENT

ADVERTISEMENT

ADVERTISEMENT

More by Harvey Castro, MD, MBA

  • Model context protocol: the standard that brings AI into clinical workflow

    Harvey Castro, MD, MBA
  • “Think twice, heal once”: Why medical decision-making needs a second opinion from your slower brain (and AI)

    Harvey Castro, MD, MBA
  • AI agents in health care: Balancing innovation, trust, and evidence-based implementation

    Harvey Castro, MD, MBA

Related Posts

  • Are negative news cycles and social media injurious to our health?

    Rabia Jalal, MD
  • How social media can help or hurt your health care career

    Health eCareers
  • Sharing mental health issues on social media

    Tarena Lofton
  • 3 ways to advance the credibility of online health information

    Robert Pearl, MD
  • Digital health equity is an emerging gap in health

    Joshua W. Elder, MD, MPH and Tamara Scott
  • Improve mental health by improving how we finance health care

    Steven Siegel, MD, PhD

More in Tech

  • Closing the gap in respiratory care: How robotics can expand access in underserved communities

    Evgeny Ignatov, MD, RRT
  • Model context protocol: the standard that brings AI into clinical workflow

    Harvey Castro, MD, MBA
  • Addressing the physician shortage: How AI can help, not replace

    Amelia Mercado
  • The silent threat in health care layoffs

    Todd Thorsen, MBA
  • In medicine and law, professions that society relies upon for accuracy

    Muhamad Aly Rifai, MD
  • “Think twice, heal once”: Why medical decision-making needs a second opinion from your slower brain (and AI)

    Harvey Castro, MD, MBA
  • Most Popular

  • Past Week

    • The silent toll of ICE raids on U.S. patient care

      Carlin Lockwood | Policy
    • Why recovery after illness demands dignity, not suspicion

      Trisza Leann Ray, DO | Physician
    • Addressing the physician shortage: How AI can help, not replace

      Amelia Mercado | Tech
    • Why medical students are trading empathy for publications

      Vijay Rajput, MD | Education
    • Why does rifaximin cost 95 percent more in the U.S. than in Asia?

      Jai Kumar, MD, Brian Nohomovich, DO, PhD and Leonid Shamban, DO | Meds
    • How conflicts of interest are eroding trust in U.S. health agencies [PODCAST]

      The Podcast by KevinMD | Podcast
  • Past 6 Months

    • What’s driving medical students away from primary care?

      ​​Vineeth Amba, MPH, Archita Goyal, and Wayne Altman, MD | Education
    • Make cognitive testing as routine as a blood pressure check

      Joshua Baker and James Jackson, PsyD | Conditions
    • The hidden bias in how we treat chronic pain

      Richard A. Lawhern, PhD | Meds
    • A faster path to becoming a doctor is possible—here’s how

      Ankit Jain | Education
    • Residency as rehearsal: the new pediatric hospitalist fellowship requirement scam

      Anonymous | Physician
    • The broken health care system doesn’t have to break you

      Jessie Mahoney, MD | Physician
  • Recent Posts

    • How conflicts of interest are eroding trust in U.S. health agencies [PODCAST]

      The Podcast by KevinMD | Podcast
    • Why young doctors in South Korea feel broken before they even begin

      Anonymous | Education
    • Measles is back: Why vaccination is more vital than ever

      American College of Physicians | Conditions
    • When errors of nature are treated as medical negligence

      Howard Smith, MD | Physician
    • Physician job change: Navigating your 457 plan and avoiding tax traps [PODCAST]

      The Podcast by KevinMD | Podcast
    • The hidden chains holding doctors back

      Neil Baum, MD | Physician

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

Leave a Comment

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

ADVERTISEMENT

ADVERTISEMENT

ADVERTISEMENT

  • Most Popular

  • Past Week

    • The silent toll of ICE raids on U.S. patient care

      Carlin Lockwood | Policy
    • Why recovery after illness demands dignity, not suspicion

      Trisza Leann Ray, DO | Physician
    • Addressing the physician shortage: How AI can help, not replace

      Amelia Mercado | Tech
    • Why medical students are trading empathy for publications

      Vijay Rajput, MD | Education
    • Why does rifaximin cost 95 percent more in the U.S. than in Asia?

      Jai Kumar, MD, Brian Nohomovich, DO, PhD and Leonid Shamban, DO | Meds
    • How conflicts of interest are eroding trust in U.S. health agencies [PODCAST]

      The Podcast by KevinMD | Podcast
  • Past 6 Months

    • What’s driving medical students away from primary care?

      ​​Vineeth Amba, MPH, Archita Goyal, and Wayne Altman, MD | Education
    • Make cognitive testing as routine as a blood pressure check

      Joshua Baker and James Jackson, PsyD | Conditions
    • The hidden bias in how we treat chronic pain

      Richard A. Lawhern, PhD | Meds
    • A faster path to becoming a doctor is possible—here’s how

      Ankit Jain | Education
    • Residency as rehearsal: the new pediatric hospitalist fellowship requirement scam

      Anonymous | Physician
    • The broken health care system doesn’t have to break you

      Jessie Mahoney, MD | Physician
  • Recent Posts

    • How conflicts of interest are eroding trust in U.S. health agencies [PODCAST]

      The Podcast by KevinMD | Podcast
    • Why young doctors in South Korea feel broken before they even begin

      Anonymous | Education
    • Measles is back: Why vaccination is more vital than ever

      American College of Physicians | Conditions
    • When errors of nature are treated as medical negligence

      Howard Smith, MD | Physician
    • Physician job change: Navigating your 457 plan and avoiding tax traps [PODCAST]

      The Podcast by KevinMD | Podcast
    • The hidden chains holding doctors back

      Neil Baum, MD | Physician

MedPage Today Professional

An Everyday Health Property Medpage Today
  • Terms of Use | Disclaimer
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Leave a Comment

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...