User vulnerability in artificial intelligence-based mental health interventions: Personality and developmental perspectives

IF 6.4
Brain-X Pub Date : 2026-07-14 DOI:10.1002/brx2.70052
Yuan Cao, Paulo Lizano
{"title":"User vulnerability in artificial intelligence-based mental health interventions: Personality and developmental perspectives","authors":"Yuan Cao,&nbsp;Paulo Lizano","doi":"10.1002/brx2.70052","DOIUrl":null,"url":null,"abstract":"<p>The rapid development of large language models is transforming psychiatric care, in part through the rise of chatbot-based digital mental health interventions. These artificial intelligence (AI)-driven interfaces function as a “digital first-aid kit” for individuals experiencing mental health challenges. Offering anonymity, immediate 24/7 access, personalized interaction, and low cost, they are often used before any contact with a human clinician. By lowering barriers to care, these tools have unprecedented potential to help close the global mental health gap. At the same time, they carry inherent risks. As Opel and Breakspear noted,<span><sup>1</sup></span> generative AI is susceptible to hallucinations and may align excessively with user intent, generating misguided or unsafe guidance that, in extreme cases, could contribute to suicide risk. While hallucinations and other model-level failures remain important concerns and may be partially mitigated through domain-specific fine-tuning and reinforcement learning,<span><sup>2</sup></span> they represent only one side of AI-related risk. The safety of AI-mediated mental health support may also be shaped by user vulnerability, including how individuals interpret, trust, and respond to AI-generated outputs. Drawing on the biopsychosocial model, we propose that personality characteristics, developmental processes, clinical vulnerabilities, and social contexts may shape these responses (Figure 1).</p><p>In general, generative AI produces responses that are linguistically plausible rather than clinically grounded. Individuals frequently engage with chatbots as trusted peers, relying on emotional subtext and culturally grounded shorthand that current AI interfaces cannot reliably interpret. Particularly in those seeking emotional reassurance, this interaction may foster a perception of empathy and understanding that exceeds the actual capabilities of AI systems. Such perceptions may increase the likelihood of anthropomorphizing chatbots and relying on their guidance in emotionally salient situations. It is possible for individuals with attachment insecurity, interpersonal sensitivity, loneliness, reassurance-seeking tendencies, or dependency-related personality traits to be more likely to perceive AI as trusted social partners. This tendency may be particularly relevant in individuals with mental disorders; conditions frequently associated with interpersonal sensitivity and personality-related vulnerabilities. Across these disorders, altered functional networks involved in self-referential processing, salience detection, and cognitive control may increase susceptibility to external guidance, although direct evidence linking these neural alterations to AI overreliance remains limited. Within this context, reliance on AI advice may be shaped less by model accuracy alone but by user characteristics that influence trust, interpretation, and dependence on AI-generated guidance. Individuals with high suggestibility or acute distress may be particularly vulnerable to developing an overreliance on AI generated guidance, potentially creating a “trust trap” in which ambiguous responses are interpreted as clinical truth. Such reliance may undermine adaptive coping strategies that are important for mental health resilience, including perspective shifting, mindfulness, interoceptive awareness, sleep regulation, and reflective practices such as journaling. Continuous access to immediate AI feedback may reduce reliance on self-regulatory mechanisms, fostering maladaptive coping centered on external rather than internal regulation. Chatbots may also lack the ability to guide users to reflect on past experiences, process trauma, or manage coping skills as therapists do. As a result, they may inadvertently displace therapeutic mechanisms that foster emotional integration and adaptive coping, making users feel interpersonal disappointment. One possible consequence is that repeated disappointing interactions with chatbots may weaken trust in subsequent therapeutic relationships with human clinicians and potentially influence future help-seeking behavior and treatment adherence. This highlights the importance of embedding AI tools within broader systems of care rather than positioning them as standalone substitutes for therapeutic relationships.</p><p>In addition, Opel and Breakspear<span><sup>1</sup></span> indicated that adolescents are a particularly vulnerable group in AI-mediated mental health support. However, emerging evidence suggests that socioemotional intelligence continues to mature extending into the mid-30s<span><sup>3</sup></span> Neurodevelopment remains ongoing, particularly in prefrontal systems involved in executive function, emotional regulation, and critical evaluation. This may limit the capacity to assess the accuracy or ambiguity of AI-generated advice. Meanwhile, socioemotional intelligence and personality trait are not yet fully consolidated across this extended developmental window; core aspects of identity, values, and interpersonal attachment patterns remain in formation, increasing sensitivity to seemingly empathic or authoritative AI tools.<span><sup>4</sup></span> From this perspective, concerns regarding overreliance on AI-delivered psychological support may extend beyond adolescence to the mid-30s. One theoretical possibility is that repeated internalization of AI-generated interpretations may contribute to changes in self-concepts, regulate emotions, and interpersonal expectations. Consequently, AI-mediated mental health interactions in youth and early adulthood through the mid-30s is not only clinical but developmental. This underscores the need for caution when deploying such technologies in populations undergoing developmental transitions, particularly those with psychiatric vulnerabilities.</p><p>These considerations are consistent with the framework of the biopsychosocial model, wherein developmental, psychological, clinical, and social factors jointly influence reliance on AI-mediated support.<span><sup>5</sup></span> Rather than functioning as standalone therapeutic agents, AI tools may be most beneficial when integrated into clinician-supervised care systems, where they can augment therapy through structured supports such as coaching, case management, and peer support.</p><p><b>Yuan Cao</b>: Conceptualization; methodology; investigation; supervision; formal analysis; visualization; writing—original draft; project administration; funding acquisition. <b>Paulo Lizano</b>: Conceptualization; methodology; investigation; funding acquisition; writing—review &amp; editing; project administration; supervision; formal analysis.</p><p>The authors declare no conflicts of interest.</p><p>Ethics approval was not required for this study.</p><p>Data sharing is not applicable to this article as no new data were created or analyzed in this study.</p>","PeriodicalId":94303,"journal":{"name":"Brain-X","volume":"4 2","pages":""},"PeriodicalIF":6.4000,"publicationDate":"2026-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/brx2.70052","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Brain-X","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/brx2.70052","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

The rapid development of large language models is transforming psychiatric care, in part through the rise of chatbot-based digital mental health interventions. These artificial intelligence (AI)-driven interfaces function as a “digital first-aid kit” for individuals experiencing mental health challenges. Offering anonymity, immediate 24/7 access, personalized interaction, and low cost, they are often used before any contact with a human clinician. By lowering barriers to care, these tools have unprecedented potential to help close the global mental health gap. At the same time, they carry inherent risks. As Opel and Breakspear noted,1 generative AI is susceptible to hallucinations and may align excessively with user intent, generating misguided or unsafe guidance that, in extreme cases, could contribute to suicide risk. While hallucinations and other model-level failures remain important concerns and may be partially mitigated through domain-specific fine-tuning and reinforcement learning,2 they represent only one side of AI-related risk. The safety of AI-mediated mental health support may also be shaped by user vulnerability, including how individuals interpret, trust, and respond to AI-generated outputs. Drawing on the biopsychosocial model, we propose that personality characteristics, developmental processes, clinical vulnerabilities, and social contexts may shape these responses (Figure 1).

In general, generative AI produces responses that are linguistically plausible rather than clinically grounded. Individuals frequently engage with chatbots as trusted peers, relying on emotional subtext and culturally grounded shorthand that current AI interfaces cannot reliably interpret. Particularly in those seeking emotional reassurance, this interaction may foster a perception of empathy and understanding that exceeds the actual capabilities of AI systems. Such perceptions may increase the likelihood of anthropomorphizing chatbots and relying on their guidance in emotionally salient situations. It is possible for individuals with attachment insecurity, interpersonal sensitivity, loneliness, reassurance-seeking tendencies, or dependency-related personality traits to be more likely to perceive AI as trusted social partners. This tendency may be particularly relevant in individuals with mental disorders; conditions frequently associated with interpersonal sensitivity and personality-related vulnerabilities. Across these disorders, altered functional networks involved in self-referential processing, salience detection, and cognitive control may increase susceptibility to external guidance, although direct evidence linking these neural alterations to AI overreliance remains limited. Within this context, reliance on AI advice may be shaped less by model accuracy alone but by user characteristics that influence trust, interpretation, and dependence on AI-generated guidance. Individuals with high suggestibility or acute distress may be particularly vulnerable to developing an overreliance on AI generated guidance, potentially creating a “trust trap” in which ambiguous responses are interpreted as clinical truth. Such reliance may undermine adaptive coping strategies that are important for mental health resilience, including perspective shifting, mindfulness, interoceptive awareness, sleep regulation, and reflective practices such as journaling. Continuous access to immediate AI feedback may reduce reliance on self-regulatory mechanisms, fostering maladaptive coping centered on external rather than internal regulation. Chatbots may also lack the ability to guide users to reflect on past experiences, process trauma, or manage coping skills as therapists do. As a result, they may inadvertently displace therapeutic mechanisms that foster emotional integration and adaptive coping, making users feel interpersonal disappointment. One possible consequence is that repeated disappointing interactions with chatbots may weaken trust in subsequent therapeutic relationships with human clinicians and potentially influence future help-seeking behavior and treatment adherence. This highlights the importance of embedding AI tools within broader systems of care rather than positioning them as standalone substitutes for therapeutic relationships.

In addition, Opel and Breakspear1 indicated that adolescents are a particularly vulnerable group in AI-mediated mental health support. However, emerging evidence suggests that socioemotional intelligence continues to mature extending into the mid-30s3 Neurodevelopment remains ongoing, particularly in prefrontal systems involved in executive function, emotional regulation, and critical evaluation. This may limit the capacity to assess the accuracy or ambiguity of AI-generated advice. Meanwhile, socioemotional intelligence and personality trait are not yet fully consolidated across this extended developmental window; core aspects of identity, values, and interpersonal attachment patterns remain in formation, increasing sensitivity to seemingly empathic or authoritative AI tools.4 From this perspective, concerns regarding overreliance on AI-delivered psychological support may extend beyond adolescence to the mid-30s. One theoretical possibility is that repeated internalization of AI-generated interpretations may contribute to changes in self-concepts, regulate emotions, and interpersonal expectations. Consequently, AI-mediated mental health interactions in youth and early adulthood through the mid-30s is not only clinical but developmental. This underscores the need for caution when deploying such technologies in populations undergoing developmental transitions, particularly those with psychiatric vulnerabilities.

These considerations are consistent with the framework of the biopsychosocial model, wherein developmental, psychological, clinical, and social factors jointly influence reliance on AI-mediated support.5 Rather than functioning as standalone therapeutic agents, AI tools may be most beneficial when integrated into clinician-supervised care systems, where they can augment therapy through structured supports such as coaching, case management, and peer support.

Yuan Cao: Conceptualization; methodology; investigation; supervision; formal analysis; visualization; writing—original draft; project administration; funding acquisition. Paulo Lizano: Conceptualization; methodology; investigation; funding acquisition; writing—review & editing; project administration; supervision; formal analysis.

The authors declare no conflicts of interest.

Ethics approval was not required for this study.

Data sharing is not applicable to this article as no new data were created or analyzed in this study.

Abstract Image

基于人工智能的心理健康干预中的用户脆弱性:个性和发展观点
与此同时,社会情绪智力和人格特征尚未在这一扩展的发展窗口中得到充分巩固;身份、价值观和人际依恋模式的核心方面仍在形成,对看似移情或权威的人工智能工具的敏感性增加从这个角度来看,对过度依赖人工智能提供的心理支持的担忧可能会从青春期延伸到35岁左右。一种理论上的可能性是,人工智能产生的解释的反复内化可能有助于改变自我概念、调节情绪和人际期望。因此,人工智能介导的青年和成年早期到35岁中期的心理健康相互作用不仅是临床的,而且是发展的。这强调了在正在经历发展转变的人群中部署此类技术时需要谨慎,特别是那些有精神脆弱性的人群。这些考虑与生物心理社会模型的框架是一致的,其中发育、心理、临床和社会因素共同影响对人工智能介导支持的依赖人工智能工具不是作为独立的治疗药物发挥作用,而是在整合到临床医生监督的护理系统中时最有益,在那里它们可以通过结构化支持(如指导、病例管理和同伴支持)来增强治疗。袁操:概念化;方法;调查;监督;正式的分析;可视化;原创作品草案;项目管理;融资收购。Paulo Lizano:概念化;方法;调查;资金收购;写作-评论&编辑;项目管理;监督;正式的分析。作者声明无利益冲突。这项研究不需要伦理批准。数据共享不适用于本文,因为本研究没有创建或分析新的数据。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书