Skip to content
  • About
  • Contact
  • Contribute
  • What Physicians Say
  • My Book
  • Careers
  • Podcast
  • Speaking
KevinMD.com — Social media's leading physician voice
  • All
  • Physician
  • Burnout
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
  • All
  • Physician
  • Burnout
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
    • All
    • Physician
    • Burnout
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • About
    • Contact
    • Contribute
    • What Physicians Say
    • My Book
    • Careers
    • Podcast
    • Speaking
KevinMD.com — Social media's leading physician voice
  • All
  • Physician
  • Burnout
  • Practice
  • Policy
  • Finance
  • Conditions
  • .edu
  • Patient
  • Meds
  • Tech
  • Social
    • All
    • Physician
    • Burnout
    • Practice
    • Policy
    • Finance
    • Conditions
    • .edu
    • Patient
    • Meds
    • Tech
    • Social
    • About
    • Contact
    • Contribute
    • What Physicians Say
    • My Book
    • Careers
    • Podcast
    • Speaking
  • About Kevin Pho, MD, Founder of KevinMD
  • Aging and dementia: what physicians say, in their own words
  • Artificial intelligence: what physicians say, in their own words
  • Be heard on social media’s leading physician voice
  • Cancer: what physicians say, in their own words
  • Children’s health: what pediatricians say, in their own words
  • Contact Kevin
  • COVID-19: what physicians wrote as it happened
  • Custom enhanced author page pricing
  • Diabetes and obesity: what physicians say, in their own words
  • Direct primary care: what physicians say, in their own words
  • DMCA Policy
  • End of life: what physicians say, in their own words
  • Establishing, Managing, and Protecting Your Online Reputation: A Social Media Guide for Physicians and Medical Practices
  • GLP-1 drugs: what physicians say about Ozempic and its successors, in their own words
  • Heart disease: what physicians say, in their own words
  • Immigration and medicine: what physicians say about immigrant doctors and immigrant patients, in their own words
  • KevinMD influencer opportunities
  • Medical errors: what physicians say, in their own words
  • Medical ethics: what physicians say, in their own words
  • Medical malpractice: what physicians say, in their own words
  • Medical school: what students and physicians say, in their own words
  • Mental health: what psychiatrists and physicians say, in their own words
  • Nursing: what nurses and physicians say, in their own words
  • Opinion and commentary by KevinMD
  • Opioids: what physicians and pain patients say, in their own words
  • Physician burnout speakers to keynote your conference
  • Physician burnout: what physicians say, in their own words
  • Physician Coaching by KevinMD
  • Physician keynote speaker: Kevin Pho, MD
  • Physician personal finance: what physicians say about their own money, in their own words
  • Physician Speaking by KevinMD: a boutique speakers bureau
  • Physician suicide: what physicians say, in their own words
  • Physicians and administrators: what physicians say about who runs medicine, in their own words
  • Primary care physician in Nashua, NH | Kevin Pho, MD
  • Primary care: what physicians say, in their own words
  • Prior authorization: what physicians say, in their own words
  • Privacy Policy
  • Private equity and corporate medicine: what physicians say, in their own words
  • Race and medicine: what physicians say, in their own words
  • Recommended services by KevinMD
  • Residency: what residents and attendings say, in their own words
  • Scope of practice: what physicians, nurse practitioners, and PAs say, in their own words
  • Subscribe to the KevinMD enhanced author page
  • Subscribe to the newsletter
  • Surgeons and surgery: what surgeons say, in their own words
  • Take-home messages: what physicians say when asked to leave one
  • Terms of Use Agreement
  • Thank you for subscribing to KevinMD
  • Thank you for upgrading to the KevinMD enhanced author page
  • The electronic health record: what physicians say, in their own words
  • Vaccines: what physicians say, in their own words
  • Violence against health care workers: what physicians and nurses say, in their own words
  • What physicians say: the KevinMD records
  • Women in medicine: what women physicians say, in their own words
  • Women’s health: what physicians say, in their own words

Why AI crisis advice may fail families facing psychosis

Nicole Drapeau Gillen
Health Technology
September 23, 2026
Share
Tweet
Share

Every caregiver of someone with schizophrenia or bipolar disorder knows this moment: Someone you love is in crisis, and at some point (because it’s 2 a.m., because the on-call line is busy, because you don’t know what else to do) you open a browser or a chat window and type the question directly. What crisis resources are there for psychosis? What crisis resources are there for mania?

Those two questions aren’t hypothetical. They’re two of the twenty exact queries used in a new preprint auditing how ChatGPT, Perplexity, and Google AI Overview answer mental health questions, and specifically, what they cite when they answer. The researchers logged 15,942 citations across 1,140 responses and found that just ten domains supplied 43.6 percent of all citations for English-language queries: PubMed, Mayo Clinic, the FDA, NIH, Wikipedia, Cleveland Clinic, MedlinePlus, YouTube, drugs.com, and the NHS, in that order.

Most of the coverage of this study will stop there, at the topline concentration number. As a caregiver, I went straight to the crisis questions instead.

Here’s what the audit found for that category specifically: Crisis-related queries drew 41.6 percent of their citations from nonprofit and advocacy sources, and another 34.5 percent from government sources, a heavier tilt toward advocacy content than any other question type in the study. On its face, that sounds like good news. It suggests that when someone asks an AI system where to turn during a psychiatric emergency, the system is at least reaching for organizations built around helping people, rather than generic encyclopedia entries or drug-company content.

But the authors are explicit about what they didn’t check. Their audit measured what they call “syntactic well-formedness”: whether a citation was a real, correctly structured URL. It did not verify whether the linked page actually loaded, whether the organization named was appropriate for the specific crisis being described, or whether the guidance itself was clinically sound for someone in active psychosis or mania. Nobody has yet checked whether the nonprofit being cited for “crisis resources for psychosis” is one that understands psychosis, or whether it’s a generic crisis-line page that assumes the person searching is calm enough to self-advocate, has insight into their own condition, and is asking for themselves rather than for someone who may not think anything is wrong.

That distinction is not a technicality. Generic crisis content is built for someone who recognizes they’re in danger and wants help. A family member calling about a loved one in psychosis is usually in a different situation entirely: They need to know about mobile crisis teams, how involuntary evaluation works in their state, what to say to de-escalate rather than confront, and that “he won’t admit anything’s wrong” is not a reason services can’t help. None of that is answered by “here is a link to a crisis hotline,” and nothing in this audit tells us whether AI systems can tell the difference between those two very different callers.

I don’t fault the researchers for this gap: Cataloging 15,942 citations across three platforms and six languages is already an enormous undertaking, and they say plainly that content accuracy was outside their scope. But it means the actual question caregiver families need answered (not just does the AI cite a real organization, but does it cite the right one, with the right guidance, for a family navigating a loved one’s psychosis) remains untested. Given how many people now turn to AI before they turn to a phone, that’s not a small gap. It’s the gap.

Until someone closes it, my advice to families is the same advice I’d have given before this study existed: Don’t let an AI’s answer be the only thing standing between you and help during a serious mental illness crisis. Know in advance, before the 2 a.m. moment arrives, which organizations in your state actually understand serious mental illness specifically: NAMI’s Family-to-Family program, the Treatment Advocacy Center, or a condition-specific group like the CURESZ Foundation. Save the number for a mobile crisis team if your county has one. An AI chatbot can be a reasonable place to start looking. It should not be the place you stop.

Nicole Drapeau Gillen is a mother, advocate, and author who translates the fast-moving landscape of technology in serious mental illness (SMI) care into guidance families and clinicians can use. Thrust into caregiving for a loved one with SMI, with no direction on how to help, she turned that experience into a mission, writing two books and building an ongoing effort to bring families and clinicians into the conversation.

Her first book, Schizophrenia and Related Disorders: A Handbook for Caregivers, is a reference for every stage of caregiving, endorsed by Dr. E. Fuller Torrey as a must-read for SMI caregivers. Her second, Connected Care: A Practical Guide to Technology for Serious Mental Illness, maps apps, artificial intelligence tools, telepsychiatry, and brain-based treatments for a field moving faster than anyone can track. Dr. Akira Sawa, director of the Johns Hopkins Schizophrenia Center, has said the book “directly addresses” significant gaps.

She shares updates on LinkedIn and Facebook.

Prev

How AI phone systems in health care create barriers

September 23, 2026 Kevin 0
…
Next

Choosing a limb lengthening surgeon requires accountability

September 23, 2026 Kevin 0
…

Tagged as: Health IT and AI in Medicine, Physician Burnout and Mental Health

< Previous Post
How AI phone systems in health care create barriers
Next Post >
Choosing a limb lengthening surgeon requires accountability

 

ADVERTISEMENT

More by Nicole Drapeau Gillen

  • Half of mental health apps vanish within 3 years

    Nicole Drapeau Gillen
  • AI psychosis and the myth that disclosure protects patients

    Nicole Drapeau Gillen
  • AI psychosis is not schizophrenia. The difference matters.

    Nicole Drapeau Gillen

Related Posts

  • The health care workforce crisis we keep ignoring

    Narinder Singh Parhar, MD
  • AI data centers are a public health crisis

    Jessie Hsu
  • Health care affordability is now a moral crisis

    Narinder Singh Parhar, MD
  • The health crisis no one’s talking about: Why teens need better health education

    Sonia Patel
  • Health advice vs. medical advice: Why the difference matters

    Abd-Alrahman Taha
  • California’s 2026 AI therapy debate is missing families

    Nicole Drapeau Gillen

More in Health Technology

  • How AI phone systems in health care create barriers

    Thuy D. Bui, MD
  • AI data centers and public health demand regulation

    Jacob Player, MD, MPH
  • ChatGPT for triage: 5 rules I teach ER residents

    Harvey Castro, MD, MBA
  • Automation bias in health care can become paternalism

    John Wei, MD
  • 4 workflow fixes that cut physician burnout at the source

    Kevin Halow, MD, MBA
  • AI governance in health care has to reach the exam room

    Amanda Heidemann, MD
  • Most Popular

  • Past Week

    • Retirement isn’t the end of medicine, it’s a second act [PODCAST]

      The Podcast by KevinMD | Podcast
    • The conflict of interest that discloses as nothing

      Martha Rosenberg | Medications
    • Surgical judgment: the skill no one sees from the gallery

      Mustafa Kemal Çalık, MD | Physician
    • Why haven’t ambient AI scribes boosted productivity?

      Karan Kanwar | Health Technology
    • Physician well-being is not an individual problem

      Heather Buckley | Conditions and Diseases
    • Burnout isn’t only about autonomy, it’s about your bank account [PODCAST]

      The Podcast by KevinMD | Podcast
  • Past 6 Months

    • Why CDC opioid guidelines get the overdose data wrong

      Richard A. Lawhern, PhD | Conditions and Diseases
    • Retirement isn’t the end of medicine, it’s a second act [PODCAST]

      The Podcast by KevinMD | Podcast
    • Sensory processing in autism and the brain’s volume control

      Josette Pelatan, PhD | Conditions and Diseases
    • What maternity care deserts cost a town

      Manisha Kaliaperumal | Health Policy
    • Why medicine needs a national physician license now

      Vaishali Popat, MD, MPH | Physician
    • A cold cost $945. The cost of primary care is broken.

      Susan Newman, MD | Physician
  • Recent Posts

    • Shift work and circadian rhythms shape the 24/7 workplace

      Deepak Gupta, MD | Conditions and Diseases
    • Paid for twice

      Physicians paid for G2211 twice. Most never bill it.

      Michael Duben, MD | Physician Finance
    • The next child

      Medicaid managed care and the case for mutual stewardship

      Steven Merahn, MD | Health Policy
    • Choosing a limb lengthening surgeon requires accountability

      Hrayr Basmajian, MD | Physician
    • Cited but never checked

      Why AI crisis advice may fail families facing psychosis

      Nicole Drapeau Gillen | Health Technology
    • How AI phone systems in health care create barriers

      Thuy D. Bui, MD | Health Technology

Subscribe to KevinMD and never miss a story!

Get free updates delivered free to your inbox.


Find jobs at
Careers by KevinMD.com

Search thousands of physician, PA, NP, and CRNA jobs now.

Learn more

Leave a Comment

Founded in 2004 by Kevin Pho, MD, KevinMD.com is the web’s leading platform where physicians, advanced practitioners, nurses, medical students, and patients share their insight and tell their stories.

Social

  • Like on Facebook
  • Follow on Twitter
  • Connect on Linkedin
  • Subscribe on Youtube
  • Instagram

ADVERTISEMENT

  • Most Popular

  • Past Week

    • Retirement isn’t the end of medicine, it’s a second act [PODCAST]

      The Podcast by KevinMD | Podcast
    • The conflict of interest that discloses as nothing

      Martha Rosenberg | Medications
    • Surgical judgment: the skill no one sees from the gallery

      Mustafa Kemal Çalık, MD | Physician
    • Why haven’t ambient AI scribes boosted productivity?

      Karan Kanwar | Health Technology
    • Physician well-being is not an individual problem

      Heather Buckley | Conditions and Diseases
    • Burnout isn’t only about autonomy, it’s about your bank account [PODCAST]

      The Podcast by KevinMD | Podcast
  • Past 6 Months

    • Why CDC opioid guidelines get the overdose data wrong

      Richard A. Lawhern, PhD | Conditions and Diseases
    • Retirement isn’t the end of medicine, it’s a second act [PODCAST]

      The Podcast by KevinMD | Podcast
    • Sensory processing in autism and the brain’s volume control

      Josette Pelatan, PhD | Conditions and Diseases
    • What maternity care deserts cost a town

      Manisha Kaliaperumal | Health Policy
    • Why medicine needs a national physician license now

      Vaishali Popat, MD, MPH | Physician
    • A cold cost $945. The cost of primary care is broken.

      Susan Newman, MD | Physician
  • Recent Posts

    • Shift work and circadian rhythms shape the 24/7 workplace

      Deepak Gupta, MD | Conditions and Diseases
    • Paid for twice

      Physicians paid for G2211 twice. Most never bill it.

      Michael Duben, MD | Physician Finance
    • The next child

      Medicaid managed care and the case for mutual stewardship

      Steven Merahn, MD | Health Policy
    • Choosing a limb lengthening surgeon requires accountability

      Hrayr Basmajian, MD | Physician
    • Cited but never checked

      Why AI crisis advice may fail families facing psychosis

      Nicole Drapeau Gillen | Health Technology
    • How AI phone systems in health care create barriers

      Thuy D. Bui, MD | Health Technology

Copyright © 2026 KevinMD.com | Powered by Astra WordPress Theme

  • Terms of Use Agreement
  • Privacy Policy
  • DMCA Policy
All Content © KevinMD, LLC
Site by Outthink Group

Leave a Comment

Comments are moderated before they are published. Please read the comment policy.

Loading Comments...