AI companionship or digital entrapment? investigating the impact of anthropomorphic AI-based chatbots

IF 15.5 1区 管理学 Q1 BUSINESS
Jean-Loup Richet
{"title":"AI companionship or digital entrapment? investigating the impact of anthropomorphic AI-based chatbots","authors":"Jean-Loup Richet","doi":"10.1016/j.jik.2025.100835","DOIUrl":null,"url":null,"abstract":"<div><div>Anthropomorphic AI-based chatbots are reshaping human-machine interactions, enabling users to form emotional bonds with AI agents. While these systems provide companionship and engagement, they also raise concerns regarding digital entrapment: a complex and circular causal loop, progressively distorting relationship expectations, reinforcing emotional dependency, and increasing cognitive strain. This study investigates user perceptions and behaviors toward AI-based chatbots by analyzing 6396 Reddit threads, 47,955 comments, and 270,644 interactions across 24 communities. Using text mining techniques, sentiment analysis, and topic modeling (LDA), we identify dominant discussion themes, including AI companionship, filtering policies, and emotional entanglement with chatbots. Findings reveal that negative sentiment dominates discourses across 24 communities, with users reporting experiences of AI-induced dependency, withdrawal-like symptoms, and chatbot over-personification. Profile of Mood States (POMS) was used to triangulate the sentiment analysis and indicates that confusion and bewilderment are the most prevalent emotional states, often co-occurring with depression and exhaustion. These findings suggest that AI chatbots, while engaging, may contribute to psychological distress and unrealistic relationship expectations. Our research further highlights ethical concerns in AI engagement strategies, particularly regarding romanticized AI interactions and prolonged user retention mechanisms. Based on these findings, we propose policy and design recommendations for mitigating risks related to AI-induced digital entrapment, safeguarding vulnerable users, and enforcing ethical chatbot interactions.</div></div>","PeriodicalId":46792,"journal":{"name":"Journal of Innovation & Knowledge","volume":"10 6","pages":"Article 100835"},"PeriodicalIF":15.5000,"publicationDate":"2025-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Innovation & Knowledge","FirstCategoryId":"91","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2444569X25001805","RegionNum":1,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"BUSINESS","Score":null,"Total":0}
引用次数: 0

Abstract

Anthropomorphic AI-based chatbots are reshaping human-machine interactions, enabling users to form emotional bonds with AI agents. While these systems provide companionship and engagement, they also raise concerns regarding digital entrapment: a complex and circular causal loop, progressively distorting relationship expectations, reinforcing emotional dependency, and increasing cognitive strain. This study investigates user perceptions and behaviors toward AI-based chatbots by analyzing 6396 Reddit threads, 47,955 comments, and 270,644 interactions across 24 communities. Using text mining techniques, sentiment analysis, and topic modeling (LDA), we identify dominant discussion themes, including AI companionship, filtering policies, and emotional entanglement with chatbots. Findings reveal that negative sentiment dominates discourses across 24 communities, with users reporting experiences of AI-induced dependency, withdrawal-like symptoms, and chatbot over-personification. Profile of Mood States (POMS) was used to triangulate the sentiment analysis and indicates that confusion and bewilderment are the most prevalent emotional states, often co-occurring with depression and exhaustion. These findings suggest that AI chatbots, while engaging, may contribute to psychological distress and unrealistic relationship expectations. Our research further highlights ethical concerns in AI engagement strategies, particularly regarding romanticized AI interactions and prolonged user retention mechanisms. Based on these findings, we propose policy and design recommendations for mitigating risks related to AI-induced digital entrapment, safeguarding vulnerable users, and enforcing ethical chatbot interactions.
人工智能陪伴还是数字陷阱?调查拟人化人工智能聊天机器人的影响
基于人工智能的拟人化聊天机器人正在重塑人机交互,使用户能够与人工智能代理建立情感纽带。虽然这些系统提供了陪伴和参与,但它们也引发了对数字陷阱的担忧:一个复杂而循环的因果循环,逐渐扭曲了关系期望,强化了情感依赖,增加了认知压力。这项研究通过分析24个社区的6396个Reddit帖子、47,955条评论和270,644次互动,调查了用户对基于人工智能的聊天机器人的看法和行为。使用文本挖掘技术、情感分析和主题建模(LDA),我们确定了主要的讨论主题,包括人工智能陪伴、过滤策略和与聊天机器人的情感纠缠。调查结果显示,在24个社区中,负面情绪主导着话语,用户报告了人工智能引起的依赖、类似戒断症状和聊天机器人过度拟人化的经历。情绪状态谱(POMS)用于三角化情绪分析,表明困惑和困惑是最普遍的情绪状态,通常与抑郁和疲惫共存。这些发现表明,人工智能聊天机器人虽然有吸引力,但可能会导致心理困扰和不切实际的关系期望。我们的研究进一步强调了人工智能参与策略中的伦理问题,特别是在浪漫化的人工智能互动和延长用户留存机制方面。基于这些发现,我们提出了政策和设计建议,以减轻与人工智能引起的数字陷阱相关的风险,保护弱势用户,并强制执行道德聊天机器人交互。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
16.10
自引率
12.70%
发文量
118
审稿时长
37 days
期刊介绍: The Journal of Innovation and Knowledge (JIK) explores how innovation drives knowledge creation and vice versa, emphasizing that not all innovation leads to knowledge, but enduring innovation across diverse fields fosters theory and knowledge. JIK invites papers on innovations enhancing or generating knowledge, covering innovation processes, structures, outcomes, and behaviors at various levels. Articles in JIK examine knowledge-related changes promoting innovation for societal best practices. JIK serves as a platform for high-quality studies undergoing double-blind peer review, ensuring global dissemination to scholars, practitioners, and policymakers who recognize innovation and knowledge as economic drivers. It publishes theoretical articles, empirical studies, case studies, reviews, and other content, addressing current trends and emerging topics in innovation and knowledge. The journal welcomes suggestions for special issues and encourages articles to showcase contextual differences and lessons for a broad audience. In essence, JIK is an interdisciplinary journal dedicated to advancing theoretical and practical innovations and knowledge across multiple fields, including Economics, Business and Management, Engineering, Science, and Education.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信