Isabella Catharina Wiest, Falk Gerrik Verhees, Dyke Ferber, Jiefu Zhu, Michael Bauer, Ute Lewitzka, Andrea Pfennig, Pavol Mikolas, Jakob Nikolas Kather
{"title":"Detection of suicidality from medical text using privacy-preserving large language models.","authors":"Isabella Catharina Wiest, Falk Gerrik Verhees, Dyke Ferber, Jiefu Zhu, Michael Bauer, Ute Lewitzka, Andrea Pfennig, Pavol Mikolas, Jakob Nikolas Kather","doi":"10.1192/bjp.2024.134","DOIUrl":"10.1192/bjp.2024.134","url":null,"abstract":"<p><strong>Background: </strong>Attempts to use artificial intelligence (AI) in psychiatric disorders show moderate success, highlighting the potential of incorporating information from clinical assessments to improve the models. This study focuses on using large language models (LLMs) to detect suicide risk from medical text in psychiatric care.</p><p><strong>Aims: </strong>To extract information about suicidality status from the admission notes in electronic health records (EHRs) using privacy-sensitive, locally hosted LLMs, specifically evaluating the efficacy of Llama-2 models.</p><p><strong>Method: </strong>We compared the performance of several variants of the open source LLM Llama-2 in extracting suicidality status from 100 psychiatric reports against a ground truth defined by human experts, assessing accuracy, sensitivity, specificity and F1 score across different prompting strategies.</p><p><strong>Results: </strong>A German fine-tuned Llama-2 model showed the highest accuracy (87.5%), sensitivity (83.0%) and specificity (91.8%) in identifying suicidality, with significant improvements in sensitivity and specificity across various prompt designs.</p><p><strong>Conclusions: </strong>The study demonstrates the capability of LLMs, particularly Llama-2, in accurately extracting information on suicidality from psychiatric records while preserving data privacy. This suggests their application in surveillance systems for psychiatric emergencies and improving the clinical management of suicidality by improving systematic quality control and research.</p>","PeriodicalId":9259,"journal":{"name":"British Journal of Psychiatry","volume":" ","pages":"532-537"},"PeriodicalIF":8.7,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11669470/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142575476","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"<i>Alias Grace</i> - Psychiatry in television.","authors":"Katherine Elizabeth Witter","doi":"10.1192/bjp.2024.204","DOIUrl":"https://doi.org/10.1192/bjp.2024.204","url":null,"abstract":"","PeriodicalId":9259,"journal":{"name":"British Journal of Psychiatry","volume":"225 6","pages":"571"},"PeriodicalIF":8.7,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142876204","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Doughnut psychiatry as a living community model for sustainable development of children.","authors":"H Bruining, J Bakker","doi":"10.1192/bjp.2024.145","DOIUrl":"https://doi.org/10.1192/bjp.2024.145","url":null,"abstract":"","PeriodicalId":9259,"journal":{"name":"British Journal of Psychiatry","volume":"225 6","pages":"579-580"},"PeriodicalIF":8.7,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142876205","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Patna Lunatic Asylum and Dr Hutchinson's lunar observations - Psychiatry in history.","authors":"Madhusudan Dalvi","doi":"10.1192/bjp.2024.139","DOIUrl":"https://doi.org/10.1192/bjp.2024.139","url":null,"abstract":"","PeriodicalId":9259,"journal":{"name":"British Journal of Psychiatry","volume":"225 6","pages":"590-591"},"PeriodicalIF":8.7,"publicationDate":"2024-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142876231","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"<i>Hearing Spiritual Voices - Medieval Mystics, Meaning and Psychiatry</i> By Christopher C.H. Cook. T & T Clark. 2023. £14.39 (pb). 152 pp. ISBN 9780567707970 - CORRIGENDUM.","authors":"Alexander Moreira-Almeida","doi":"10.1192/bjp.2024.246","DOIUrl":"https://doi.org/10.1192/bjp.2024.246","url":null,"abstract":"","PeriodicalId":9259,"journal":{"name":"British Journal of Psychiatry","volume":" ","pages":"1"},"PeriodicalIF":8.7,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142738459","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"<i>Inside Out 2</i>: the adolescent mind and the role of anxiety - Psychiatry in movies.","authors":"Harry Barker","doi":"10.1192/bjp.2024.206","DOIUrl":"https://doi.org/10.1192/bjp.2024.206","url":null,"abstract":"","PeriodicalId":9259,"journal":{"name":"British Journal of Psychiatry","volume":"225 5","pages":"516"},"PeriodicalIF":8.7,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142806181","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Portable ultra-low-field MRI: scanning new horizons in dementia detection.","authors":"Joanne Rodda, James Dobrzanski, Sukhi Shergill","doi":"10.1192/bjp.2024.185","DOIUrl":"https://doi.org/10.1192/bjp.2024.185","url":null,"abstract":"","PeriodicalId":9259,"journal":{"name":"British Journal of Psychiatry","volume":"225 5","pages":"506-507"},"PeriodicalIF":8.7,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142806359","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Violence and schizophrenia: let us take a deep breath and gain a meta-perspective.","authors":"Natalia Tesli, Anja Vaskinn","doi":"10.1192/bjp.2024.187","DOIUrl":"https://doi.org/10.1192/bjp.2024.187","url":null,"abstract":"","PeriodicalId":9259,"journal":{"name":"British Journal of Psychiatry","volume":"225 5","pages":"508-509"},"PeriodicalIF":8.7,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142806367","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Prevalence and risk of psychiatric disorders in young people: prospective cohort study exploring the role of childhood trauma (the HUNT study).","authors":"Helle Stangeland, Helene Flood Aakvaag, Monica Baumann-Larsen, Tore Wentzel-Larsen, Akiah Ottesen, John Anker Zwart, Kjersti Storheim, Grete Dyb, Synne Øien Stensland","doi":"10.1192/bjp.2024.98","DOIUrl":"10.1192/bjp.2024.98","url":null,"abstract":"<p><strong>Background: </strong>Better knowledge about childhood trauma as a risk factor for psychiatric disorders in young people could help strengthen the timeliness and effectiveness of prevention and treatment efforts.</p><p><strong>Aims: </strong>To estimate the prevalence and risk of psychiatric disorders in young people following exposure to childhood trauma, including interpersonal violence.</p><p><strong>Method: </strong>This prospective cohort study followed 8199 adolescents (age range 12-20 years) over 13-15 years, into young adulthood (age range 25-35 years). Data about childhood trauma exposure from adolescents participating in the Trøndelag Health Study (HUNT, 2006-2008) were linked to data about subsequent development of psychiatric disorders from the Norwegian Patient Registry (2008-2021).</p><p><strong>Results: </strong>One in four (24.3%) adolescents were diagnosed with a psychiatric disorder by young adulthood. Regression analyses showed consistent and significant relationships between childhood exposure to both interpersonal violence and other potentially traumatic events, and subsequent psychiatric disorders and psychiatric comorbidity. The highest estimates were observed for childhood exposure to two or more types of interpersonal violence (polyvictimisation), and development of psychotic disorders (odds ratio 3.41, 95% CI 1.93-5.72), stress and adjustment disorders (odds ratio 4.20, 95% CI 3.05-5.71), personality disorders (odds ratio 3.98, 95% CI 2.70-5.76), alcohol-related disorders (odds ratio 3.28, 95% CI 2.06-5.04) and drug-related disorders (odds ratio 4.67, 95% CI 2.87-7.33).</p><p><strong>Conclusions: </strong>These findings emphasise the importance of integrating knowledge about childhood trauma as a potent risk factor for psychopathology into the planning and implementation of services for children, adolescents and young adults.</p>","PeriodicalId":9259,"journal":{"name":"British Journal of Psychiatry","volume":" ","pages":"476-483"},"PeriodicalIF":8.7,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11663475/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141900928","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}