Lubomir Barabas, Michal Novotny, Dennis Jung, Thomas Müller, Nicolas Nagysomkuti Mertse
{"title":"Exploring the potential of ChatGPT as a digital advisor in acute psychiatric crises: a feasibility study.","authors":"Lubomir Barabas, Michal Novotny, Dennis Jung, Thomas Müller, Nicolas Nagysomkuti Mertse","doi":"10.1007/s00115-025-01837-3","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>This exploratory study tested ChatGPT as a digital advisor chatbot for German-speaking individuals in acute psychiatric crises. Additionally, the attitudes of young physicians and psychologists towards the use of large language models (LLMs) in healthcare were investigated.</p><p><strong>Methods: </strong>In total, 20 resident physicians and psychologists simulated patients in three clinical scenarios (depression, psychosis, adjustment disorder) and interacted with ChatGPT. They evaluated the chatbot's performance regarding overall experience, pleasantness, appropriateness of the responses, realism, and helpfulness. Before and after the intervention, their attitudes towards such a chatbot were assessed. Finally, they assessed 12 statements about the future of LLMs in healthcare and provided open feedback on the chat experience.</p><p><strong>Results: </strong>ChatGPT received predominantly positive ratings (over 8/10 points) for overall experience, helpfulness, pleasantness, and appropriateness, while realism was rated slightly lower at 7/10 points. The appropriateness of the responses varied significantly between the scenarios, with lower ratings for the psychosis scenario. Open feedback confirmed the limited suitability of ChatGPT for psychosis patients. Overall, 70% or more of the participants agreed that LLMs will become increasingly important in everyday life and healthcare, and that an LLM-based chatbot would be a modern tool for low-threshold access to initial psychiatric aid. However, the high number of neutral responses across all 12 items (20-45%) indicates uncertainty regarding the actual benefits and risks.</p><p><strong>Conclusion: </strong>The performance of ChatGPT was rated positively overall by the participants. Significant practical and methodological limitations remain, however, highlighting the need for further research including real patients for a gradual, carefully monitored integration of LLMs into mental healthcare.</p>","PeriodicalId":49770,"journal":{"name":"Nervenarzt","volume":" ","pages":""},"PeriodicalIF":1.1000,"publicationDate":"2025-06-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nervenarzt","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s00115-025-01837-3","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background: This exploratory study tested ChatGPT as a digital advisor chatbot for German-speaking individuals in acute psychiatric crises. Additionally, the attitudes of young physicians and psychologists towards the use of large language models (LLMs) in healthcare were investigated.
Methods: In total, 20 resident physicians and psychologists simulated patients in three clinical scenarios (depression, psychosis, adjustment disorder) and interacted with ChatGPT. They evaluated the chatbot's performance regarding overall experience, pleasantness, appropriateness of the responses, realism, and helpfulness. Before and after the intervention, their attitudes towards such a chatbot were assessed. Finally, they assessed 12 statements about the future of LLMs in healthcare and provided open feedback on the chat experience.
Results: ChatGPT received predominantly positive ratings (over 8/10 points) for overall experience, helpfulness, pleasantness, and appropriateness, while realism was rated slightly lower at 7/10 points. The appropriateness of the responses varied significantly between the scenarios, with lower ratings for the psychosis scenario. Open feedback confirmed the limited suitability of ChatGPT for psychosis patients. Overall, 70% or more of the participants agreed that LLMs will become increasingly important in everyday life and healthcare, and that an LLM-based chatbot would be a modern tool for low-threshold access to initial psychiatric aid. However, the high number of neutral responses across all 12 items (20-45%) indicates uncertainty regarding the actual benefits and risks.
Conclusion: The performance of ChatGPT was rated positively overall by the participants. Significant practical and methodological limitations remain, however, highlighting the need for further research including real patients for a gradual, carefully monitored integration of LLMs into mental healthcare.
期刊介绍：
Der Nervenarzt is an internationally recognized journal addressing neurologists and psychiatrists working in clinical or practical environments. Essential findings and current information from neurology, psychiatry as well as neuropathology, neurosurgery up to psychotherapy are presented.
Review articles provide an overview on selected topics and offer the reader a summary of current findings from all fields of neurology and psychiatry.
Freely submitted original papers allow the presentation of important clinical studies and serve the scientific exchange.
Review articles under the rubric ''Continuing Medical Education'' present verified results of scientific research and their integration into daily practice.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
