Potential Pitfalls With Automatic Sentiment Analysis: The Example of Queerphobic Bias.

IF 3 2区社会学 Q2 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS

Social Science Computer Review Pub Date : 2023-12-01 Epub Date: 2023-02-02 DOI:10.1177/08944393231152946

Eddie L Ungless, Björn Ross, Vaishak Belle

引用次数: 2

Abstract

Automated sentiment analysis can help efficiently detect trends in patients' moods, consumer preferences, political attitudes and more. Unfortunately, like many natural language processing techniques, sentiment analysis can show bias against marginalised groups. We illustrate this point by showing how six popular sentiment analysis tools respond to sentences about queer identities, expanding on existing work on gender, ethnicity and disability. We find evidence of bias against several marginalised queer identities, including in the two models from Google and Amazon that seem to have been subject to superficial debiasing. We conclude with guidance on selecting a sentiment analysis tool to minimise the risk of model bias skewing results.

查看原文本刊更多论文

自动情绪分析的潜在陷阱:同性恋恐惧症偏见的例子

自动情绪分析可以帮助有效地检测患者情绪、消费者偏好、政治态度等方面的趋势。不幸的是，像许多自然语言处理技术一样，情感分析可能会显示出对边缘群体的偏见。我们通过展示六种流行的情感分析工具如何回应关于酷儿身份的句子来说明这一点，扩展了现有的关于性别、种族和残疾的工作。我们发现了一些针对边缘酷儿身份的偏见的证据，包括谷歌和亚马逊的两个模型，它们似乎受到了肤浅的偏见。最后，我们提供了选择情感分析工具的指导，以最大限度地减少模型偏差扭曲结果的风险。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Social Science Computer Review 社会科学-计算机：跨学科应用

CiteScore

9.00

自引率

4.90%

发文量

审稿时长

>12 weeks

期刊介绍： Unique Scope Social Science Computer Review is an interdisciplinary journal covering social science instructional and research applications of computing, as well as societal impacts of informational technology. Topics included: artificial intelligence, business, computational social science theory, computer-assisted survey research, computer-based qualitative analysis, computer simulation, economic modeling, electronic modeling, electronic publishing, geographic information systems, instrumentation and research tools, public administration, social impacts of computing and telecommunications, software evaluation, world-wide web resources for social scientists. Interdisciplinary Nature Because the Uses and impacts of computing are interdisciplinary, so is Social Science Computer Review. The journal is of direct relevance to scholars and scientists in a wide variety of disciplines. In its pages you''ll find work in the following areas: sociology, anthropology, political science, economics, psychology, computer literacy, computer applications, and methodology.