Simon Bruno Egli, Armon Arpagaus, Simon Adrian Amacher, Sabina Hunziker, Stefano Bassetti
{"title":"使用,知识和感知的大型语言模型在临床实践:在瑞士临床医生的横断面混合方法调查。","authors":"Simon Bruno Egli, Armon Arpagaus, Simon Adrian Amacher, Sabina Hunziker, Stefano Bassetti","doi":"10.1136/bmjhci-2025-101470","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>Large language model (LLM)-based tools offer potential for clinical practice but raise concerns regarding output accuracy, patient safety and data security. We aimed to assess Swiss clinicians' use, knowledge and perception of LLMs and identify associated factors.</p><p><strong>Methods: </strong>An anonymous online survey was distributed via 34 medical societies in Switzerland. The primary outcome was frequent use of LLMs (at least weekly use). The secondary outcome was higher knowledge regarding LLMs (score above the median in an 11-item test). Qualitative analysis explored clinicians' perceptions of LLM-related opportunities and risks.</p><p><strong>Results: </strong>Among 685 participants (response rate 29.0%), 225 (32.8%) reported frequent use of LLMs, 25 (3.6%) reported having used a specific medical LLM and 42 (6%) reported the availability of workplace LLM guidelines. The median knowledge test score was 6 points (IQR 4-8 points). Multivariable analysis showed that younger age, male sex and research activity were significantly associated with frequent use and higher knowledge. Qualitative analysis identified administrative support, analytical assistance and access to information as key opportunities. The main risks identified were declining clinical skills, poor output quality and legal or ethical concerns.</p><p><strong>Discussion: </strong>The study highlights a notable adoption of LLMs among Swiss clinicians, particularly among younger, male and research-active individuals. However, the limited availability of workplace guidelines raises concerns about safe and effective use.</p><p><strong>Conclusion: </strong>The gap between widespread LLM use and the scarcity of workplace guidelines underscores the need for accessible educational resources and clinical guidelines to mitigate potential risks and promote informed use.</p>","PeriodicalId":9050,"journal":{"name":"BMJ Health & Care Informatics","volume":"32 1","pages":""},"PeriodicalIF":4.4000,"publicationDate":"2025-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12458741/pdf/","citationCount":"0","resultStr":"{\"title\":\"Use, knowledge and perception of large language models in clinical practice: a cross-sectional mixed-methods survey among clinicians in Switzerland.\",\"authors\":\"Simon Bruno Egli, Armon Arpagaus, Simon Adrian Amacher, Sabina Hunziker, Stefano Bassetti\",\"doi\":\"10.1136/bmjhci-2025-101470\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objectives: </strong>Large language model (LLM)-based tools offer potential for clinical practice but raise concerns regarding output accuracy, patient safety and data security. We aimed to assess Swiss clinicians' use, knowledge and perception of LLMs and identify associated factors.</p><p><strong>Methods: </strong>An anonymous online survey was distributed via 34 medical societies in Switzerland. The primary outcome was frequent use of LLMs (at least weekly use). The secondary outcome was higher knowledge regarding LLMs (score above the median in an 11-item test). Qualitative analysis explored clinicians' perceptions of LLM-related opportunities and risks.</p><p><strong>Results: </strong>Among 685 participants (response rate 29.0%), 225 (32.8%) reported frequent use of LLMs, 25 (3.6%) reported having used a specific medical LLM and 42 (6%) reported the availability of workplace LLM guidelines. The median knowledge test score was 6 points (IQR 4-8 points). Multivariable analysis showed that younger age, male sex and research activity were significantly associated with frequent use and higher knowledge. Qualitative analysis identified administrative support, analytical assistance and access to information as key opportunities. The main risks identified were declining clinical skills, poor output quality and legal or ethical concerns.</p><p><strong>Discussion: </strong>The study highlights a notable adoption of LLMs among Swiss clinicians, particularly among younger, male and research-active individuals. However, the limited availability of workplace guidelines raises concerns about safe and effective use.</p><p><strong>Conclusion: </strong>The gap between widespread LLM use and the scarcity of workplace guidelines underscores the need for accessible educational resources and clinical guidelines to mitigate potential risks and promote informed use.</p>\",\"PeriodicalId\":9050,\"journal\":{\"name\":\"BMJ Health & Care Informatics\",\"volume\":\"32 1\",\"pages\":\"\"},\"PeriodicalIF\":4.4000,\"publicationDate\":\"2025-09-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12458741/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"BMJ Health & Care Informatics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1136/bmjhci-2025-101470\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"HEALTH CARE SCIENCES & SERVICES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMJ Health & Care Informatics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1136/bmjhci-2025-101470","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
Use, knowledge and perception of large language models in clinical practice: a cross-sectional mixed-methods survey among clinicians in Switzerland.
Objectives: Large language model (LLM)-based tools offer potential for clinical practice but raise concerns regarding output accuracy, patient safety and data security. We aimed to assess Swiss clinicians' use, knowledge and perception of LLMs and identify associated factors.
Methods: An anonymous online survey was distributed via 34 medical societies in Switzerland. The primary outcome was frequent use of LLMs (at least weekly use). The secondary outcome was higher knowledge regarding LLMs (score above the median in an 11-item test). Qualitative analysis explored clinicians' perceptions of LLM-related opportunities and risks.
Results: Among 685 participants (response rate 29.0%), 225 (32.8%) reported frequent use of LLMs, 25 (3.6%) reported having used a specific medical LLM and 42 (6%) reported the availability of workplace LLM guidelines. The median knowledge test score was 6 points (IQR 4-8 points). Multivariable analysis showed that younger age, male sex and research activity were significantly associated with frequent use and higher knowledge. Qualitative analysis identified administrative support, analytical assistance and access to information as key opportunities. The main risks identified were declining clinical skills, poor output quality and legal or ethical concerns.
Discussion: The study highlights a notable adoption of LLMs among Swiss clinicians, particularly among younger, male and research-active individuals. However, the limited availability of workplace guidelines raises concerns about safe and effective use.
Conclusion: The gap between widespread LLM use and the scarcity of workplace guidelines underscores the need for accessible educational resources and clinical guidelines to mitigate potential risks and promote informed use.