Exploring the efficacy of ChatGPT in understanding and identifying intimate partner violence

IF 1.7 3区社会学 Q2 FAMILY STUDIES

Family Relations Pub Date : 2025-03-26 DOI:10.1111/fare.13176

Ying Zhang, Jun Fang, Xiaochen Luo, Danielle Lindsay, Nabiha Madre, Jean Paredes, Alan Penna, Emma Melley, Tatum Garcia

{"title":"Exploring the efficacy of ChatGPT in understanding and identifying intimate partner violence","authors":"Ying Zhang, Jun Fang, Xiaochen Luo, Danielle Lindsay, Nabiha Madre, Jean Paredes, Alan Penna, Emma Melley, Tatum Garcia","doi":"10.1111/fare.13176","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Objective</h3>\n \n <p>This study aims to examine the efficiency and consistency of ChatGPT in identifying intimate partner violence (IPV) and the frequency of emotional and informational support ChatGPT provided.</p>\n </section>\n \n <section>\n \n <h3> Background</h3>\n \n <p>The integration of artificial intelligence–based conversational large language models, such as ChatGPT, in understanding relationship dynamics has sparked both interest and debate within the scientific community. This tool could be valuable in offering immediate, personalized responses to questions about relationships, including those involving conflicts and violence.</p>\n </section>\n \n <section>\n \n <h3> Method</h3>\n \n <p>We extracted 500 posts involving IPV and 80 posts involving nonviolent family tension from online IPV help-seeking forums as prompts for ChatGPT (Version 3.5). We coded ChatGPT's responses and examined their congruence and consistency in identifying IPV compared to human experts. We also examined incidents where ChatGPT misjudged. Lastly, we assessed the presence of informational and emotional support in ChatGPT's responses to prompts involving IPV.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>ChatGPT-3.5 was able to identify cases involving IPV (physical violence, psychological violence, and controlling behavior) correctly in 91.2% of the cases. Misjudgment mostly occurred due to community policies or nuanced context information. ChatGPT consistently provided emotional support and informational support to users who presented IPV-related inquiries.</p>\n </section>\n \n <section>\n \n <h3> Conclusion</h3>\n \n <p>ChatGPT-3.5 could reach a relatively high accuracy and consistency in identifying IPV and can provide supportive responses.</p>\n </section>\n \n <section>\n \n <h3> Implications</h3>\n \n <p>ChatGPT can serve as an initial resource for individuals and family members seeking help with IPV, offering immediate, empathetic, and informational support. However, improvements are needed to address its limitations in handling nuanced cases and to ensure ethical use and user safety.</p>\n </section>\n </div>","PeriodicalId":48206,"journal":{"name":"Family Relations","volume":"74 3","pages":"1233-1249"},"PeriodicalIF":1.7000,"publicationDate":"2025-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Family Relations","FirstCategoryId":"90","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/fare.13176","RegionNum":3,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"FAMILY STUDIES","Score":null,"Total":0}

引用次数: 0

Abstract

Objective

This study aims to examine the efficiency and consistency of ChatGPT in identifying intimate partner violence (IPV) and the frequency of emotional and informational support ChatGPT provided.

Background

The integration of artificial intelligence–based conversational large language models, such as ChatGPT, in understanding relationship dynamics has sparked both interest and debate within the scientific community. This tool could be valuable in offering immediate, personalized responses to questions about relationships, including those involving conflicts and violence.

Method

We extracted 500 posts involving IPV and 80 posts involving nonviolent family tension from online IPV help-seeking forums as prompts for ChatGPT (Version 3.5). We coded ChatGPT's responses and examined their congruence and consistency in identifying IPV compared to human experts. We also examined incidents where ChatGPT misjudged. Lastly, we assessed the presence of informational and emotional support in ChatGPT's responses to prompts involving IPV.

Results

ChatGPT-3.5 was able to identify cases involving IPV (physical violence, psychological violence, and controlling behavior) correctly in 91.2% of the cases. Misjudgment mostly occurred due to community policies or nuanced context information. ChatGPT consistently provided emotional support and informational support to users who presented IPV-related inquiries.

Conclusion

ChatGPT-3.5 could reach a relatively high accuracy and consistency in identifying IPV and can provide supportive responses.

Implications

ChatGPT can serve as an initial resource for individuals and family members seeking help with IPV, offering immediate, empathetic, and informational support. However, improvements are needed to address its limitations in handling nuanced cases and to ensure ethical use and user safety.

查看原文本刊更多论文

探讨ChatGPT在理解和识别亲密伴侣暴力中的功效

目的探讨ChatGPT识别亲密伴侣暴力（IPV）的有效性和一致性，以及ChatGPT提供情感和信息支持的频率。基于人工智能的会话大型语言模型，如ChatGPT，在理解关系动态方面的集成引发了科学界的兴趣和争论。这一工具在对包括冲突和暴力在内的人际关系问题提供即时、个性化的回答方面可能很有价值。方法我们从网上IPV求助论坛中提取了500篇涉及IPV的帖子和80篇涉及非暴力家庭紧张的帖子，作为ChatGPT（3.5版）的提示。我们对ChatGPT的回答进行了编码，并与人类专家相比，检查了他们在识别IPV方面的一致性和一致性。我们还检查了ChatGPT错误判断的事件。最后，我们评估了ChatGPT对涉及IPV的提示的反应中信息和情感支持的存在。结果ChatGPT-3.5能够正确识别91.2%的IPV（身体暴力、心理暴力和控制行为）病例。错误判断主要是由于社区政策或微妙的上下文信息造成的。ChatGPT始终如一地为提出ipvv相关查询的用户提供情感支持和信息支持。结论ChatGPT-3.5对IPV的识别具有较高的准确性和一致性，可提供支持性应答。ChatGPT可以作为寻求IPV帮助的个人和家庭成员的初始资源，提供即时、移情和信息支持。然而，需要改进以解决其在处理细微情况方面的局限性，并确保合乎道德的使用和用户安全。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Family Relations Multiple-

CiteScore

3.40

自引率

13.60%

发文量

164

期刊介绍： A premier, applied journal of family studies, Family Relations is mandatory reading for family scholars and all professionals who work with families, including: family practitioners, educators, marriage and family therapists, researchers, and social policy specialists. The journal"s content emphasizes family research with implications for intervention, education, and public policy, always publishing original, innovative and interdisciplinary works with specific recommendations for practice.