Data integrity in an online world: Demonstration of multimodal bot screening tools and considerations for preserving data integrity in two online social and behavioral research studies with marginalized populations.

IF 7.6 1区心理学 Q1 PSYCHOLOGY, MULTIDISCIPLINARY

Psychological methods Pub Date : 2024-09-09 DOI:10.1037/met0000696

Arryn A Guy,Matthew J Murphy,David G Zelaya,Christopher W Kahler,Shufang Sun

{"title":"Data integrity in an online world: Demonstration of multimodal bot screening tools and considerations for preserving data integrity in two online social and behavioral research studies with marginalized populations.","authors":"Arryn A Guy,Matthew J Murphy,David G Zelaya,Christopher W Kahler,Shufang Sun","doi":"10.1037/met0000696","DOIUrl":null,"url":null,"abstract":"Internet-based studies are widely used in social and behavioral health research, yet bots and fraud from \"survey farming\" bring significant threats to data integrity. For research centering marginalized communities, data integrity is an ethical imperative, as fraudulent data at a minimum poses a threat to scientific integrity, and worse could even promulgate false, negative stereotypes about the population of interest. Using data from two online surveys of sexual and gender minority populations (young men who have sex with men and transgender women of color), we (a) demonstrate the use of online survey techniques to identify and mitigate internet-based fraud, (b) differentiate techniques for and identify two different types of \"survey farming\" (i.e., bots and false responders), and (c) demonstrate the consequences of those distinct types of fraud on sample characteristics and statistical inferences, if fraud goes unaddressed. We provide practical recommendations for internet-based studies in psychological, social, and behavioral health research to ensure data integrity and discuss implications for future research testing data integrity techniques. (PsycInfo Database Record (c) 2024 APA, all rights reserved).","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":"1 1","pages":""},"PeriodicalIF":7.6000,"publicationDate":"2024-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Psychological methods","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/met0000696","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, MULTIDISCIPLINARY","Score":null,"Total":0}

引用次数: 0

Abstract

Internet-based studies are widely used in social and behavioral health research, yet bots and fraud from "survey farming" bring significant threats to data integrity. For research centering marginalized communities, data integrity is an ethical imperative, as fraudulent data at a minimum poses a threat to scientific integrity, and worse could even promulgate false, negative stereotypes about the population of interest. Using data from two online surveys of sexual and gender minority populations (young men who have sex with men and transgender women of color), we (a) demonstrate the use of online survey techniques to identify and mitigate internet-based fraud, (b) differentiate techniques for and identify two different types of "survey farming" (i.e., bots and false responders), and (c) demonstrate the consequences of those distinct types of fraud on sample characteristics and statistical inferences, if fraud goes unaddressed. We provide practical recommendations for internet-based studies in psychological, social, and behavioral health research to ensure data integrity and discuss implications for future research testing data integrity techniques. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

查看原文本刊更多论文

网络世界的数据完整性：在两项针对边缘化人群的在线社会和行为研究中，展示多模式僵尸筛选工具并考虑维护数据完整性。

基于互联网的研究被广泛应用于社会和行为健康研究中，然而 "调查农业 "中的机器人和欺诈行为对数据完整性造成了严重威胁。对于以边缘化群体为中心的研究来说，数据完整性是道德上的当务之急，因为欺诈性数据至少会对科学诚信构成威胁，更有甚者甚至会对相关人群造成错误、负面的刻板印象。利用对性和性别少数群体（男男性行为者和有色人种变性女性）进行的两项在线调查的数据，我们（a）展示了如何使用在线调查技术来识别和减少基于互联网的欺诈行为，（b）区分并识别了两种不同类型的 "调查农业"（即机器人和虚假应答者），以及（c）展示了如果不处理欺诈行为，这些不同类型的欺诈行为会对样本特征和统计推断产生的后果。我们为基于互联网的心理、社会和行为健康研究提供了切实可行的建议，以确保数据的完整性，并讨论了测试数据完整性技术的未来研究的意义。(PsycInfo 数据库记录 (c) 2024 APA，保留所有权利）。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Psychological methods PSYCHOLOGY, MULTIDISCIPLINARY-

CiteScore

13.10

自引率

7.10%

发文量

159

期刊介绍： Psychological Methods is devoted to the development and dissemination of methods for collecting, analyzing, understanding, and interpreting psychological data. Its purpose is the dissemination of innovations in research design, measurement, methodology, and quantitative and qualitative analysis to the psychological community; its further purpose is to promote effective communication about related substantive and methodological issues. The audience is expected to be diverse and to include those who develop new procedures, those who are responsible for undergraduate and graduate training in design, measurement, and statistics, as well as those who employ those procedures in research.