Real-World Testing of an Artificial Intelligence Conversational Agent as an Early Intervention and Support Tool in the Mental Health Referral Care Pathway: A Mixed-Methods Study.
Edward Meinert, Madison Milne-Ives, Emma Taylor, Becky Inkster, Alina Paik, Ananya Ananthakrishnan, Martin Orr, Ceire Costelloe, Rohit Shankar
{"title":"Real-World Testing of an Artificial Intelligence Conversational Agent as an Early Intervention and Support Tool in the Mental Health Referral Care Pathway: A Mixed-Methods Study.","authors":"Edward Meinert, Madison Milne-Ives, Emma Taylor, Becky Inkster, Alina Paik, Ananya Ananthakrishnan, Martin Orr, Ceire Costelloe, Rohit Shankar","doi":"10.1177/00207640251415507","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>The incidence of mental health concerns is growing, and demand for support is exceeding service capacity. Digital tools can provide additional support but risk causing harm if not delivered safely.</p><p><strong>Aims: </strong>We aimed to establish real-world evidence of the impact of an artificial intelligence-based mental health conversational agent (Wysa) on depression and anxiety in patients waiting for Talking Therapies treatment.</p><p><strong>Methods: </strong>A mixed-methods randomized controlled trial was conducted with patients referred to Talking Therapies in the Central and Northwest London NHS Foundation Trust. The primary outcome was change in depression severity over 12 weeks between groups; secondary outcomes included anxiety severity, quality of life, safety, engagement, and app usage. Comparative analyses used linear regression; thematic analysis was conducted on qualitative data.</p><p><strong>Results: </strong>2,161 patients were screened, 625 were invited, 99 consented, and 76 were randomized (2:1). Thirty patients were lost to follow-up. Descriptive analysis found that mean differences in depression were similar between arms, but with large standard deviations (<i>M</i> = 2.62, <i>SD</i> = 5.07 and 6.56 for Wysa; <i>M</i> = 2.59, <i>SD</i> = 4.38 and 3.82 for control). Results were similar for secondary outcomes. Wysa was potentially helpful, easy to use, and appreciated as an accessible source of support, but limitations with the conversational agent negatively affected engagement.</p><p><strong>Conclusions: </strong>Although sample size limited the analysis, participant feedback highlighted its potential to supplement clinical services. Our study findings suggest that the change of depression score is similar in both arms thus indicating that there is no evidence that Wysa treats depression in this study. However, limited sample size could have influenced this. Key lessons to improve the quality of effectiveness studies of digital health technologies were identified.</p>","PeriodicalId":14304,"journal":{"name":"International Journal of Social Psychiatry","volume":" ","pages":"1819-1832"},"PeriodicalIF":2.7000,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13569919/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Social Psychiatry","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1177/00207640251415507","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/3/5 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"PSYCHIATRY","Score":null,"Total":0}
引用次数: 0
Abstract
Background: The incidence of mental health concerns is growing, and demand for support is exceeding service capacity. Digital tools can provide additional support but risk causing harm if not delivered safely.
Aims: We aimed to establish real-world evidence of the impact of an artificial intelligence-based mental health conversational agent (Wysa) on depression and anxiety in patients waiting for Talking Therapies treatment.
Methods: A mixed-methods randomized controlled trial was conducted with patients referred to Talking Therapies in the Central and Northwest London NHS Foundation Trust. The primary outcome was change in depression severity over 12 weeks between groups; secondary outcomes included anxiety severity, quality of life, safety, engagement, and app usage. Comparative analyses used linear regression; thematic analysis was conducted on qualitative data.
Results: 2,161 patients were screened, 625 were invited, 99 consented, and 76 were randomized (2:1). Thirty patients were lost to follow-up. Descriptive analysis found that mean differences in depression were similar between arms, but with large standard deviations (M = 2.62, SD = 5.07 and 6.56 for Wysa; M = 2.59, SD = 4.38 and 3.82 for control). Results were similar for secondary outcomes. Wysa was potentially helpful, easy to use, and appreciated as an accessible source of support, but limitations with the conversational agent negatively affected engagement.
Conclusions: Although sample size limited the analysis, participant feedback highlighted its potential to supplement clinical services. Our study findings suggest that the change of depression score is similar in both arms thus indicating that there is no evidence that Wysa treats depression in this study. However, limited sample size could have influenced this. Key lessons to improve the quality of effectiveness studies of digital health technologies were identified.
期刊介绍：
The International Journal of Social Psychiatry, established in 1954, is a leading publication dedicated to the field of social psychiatry. It serves as a platform for the exchange of research findings and discussions on the influence of social, environmental, and cultural factors on mental health and well-being. The journal is particularly relevant to psychiatrists and multidisciplinary professionals globally who are interested in understanding the broader context of psychiatric disorders and their impact on individuals and communities.
Social psychiatry, as a discipline, focuses on the origins and outcomes of mental health issues within a social framework, recognizing the interplay between societal structures and individual mental health. The journal draws connections with related fields such as social anthropology, cultural psychiatry, and sociology, and is influenced by the latest developments in these areas.
The journal also places a special emphasis on fast-track publication for brief communications, ensuring that timely and significant research can be disseminated quickly. Additionally, it strives to reflect its international readership by publishing state-of-the-art reviews from various regions around the world, showcasing the diverse practices and perspectives within the psychiatric disciplines. This approach not only contributes to the scientific understanding of social psychiatry but also supports the global exchange of knowledge and best practices in mental health care.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
