On the use of receiver operating characteristic area under the curve in eyewitness memory research

IF 1.9 2区社会学 Q1 CRIMINOLOGY & PENOLOGY

Legal and Criminological Psychology Pub Date : 2024-11-04 DOI:10.1111/lcrp.12300

Paul Riesthuis, Henry Otgaar

{"title":"On the use of receiver operating characteristic area under the curve in eyewitness memory research","authors":"Paul Riesthuis, Henry Otgaar","doi":"10.1111/lcrp.12300","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Purpose</h3>\n \n <p>Eyewitness memory research has reformed police practices and policy and is sometimes relied upon in legal proceedings. Due to the practical implications derived from this research, it is imperative to evaluate how practical recommendations are postulated. To assess the practical relevance of research, effect sizes and their interpretation play a pivotal role.</p>\n </section>\n \n <section>\n \n <h3> Methods</h3>\n \n <p>We examined how the frequently used effect size Area Under the Curve (AUC) obtained via Receiver Operating Characteristic (ROC) curves are used and interpreted in eyewitness memory research. We identified 157 eyewitness memory related articles that conducted ROC curve analyses resulting in 1580 AUCs.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>Approximately 90% of the AUCs were only interpreted via statistical significance. The majority of studies did not report 95%CIs for their AUCs. Finally, power analyses were frequently not conducted or not reproducible.</p>\n </section>\n \n <section>\n \n <h3> Conclusions</h3>\n \n <p>To improve the practical inferences of eyewitness memory research, we recommend establishing a smallest effect size of interest, focusing on 95%CIs, and conducting reproducible power analyses.</p>\n </section>\n </div>","PeriodicalId":18022,"journal":{"name":"Legal and Criminological Psychology","volume":"30 2","pages":"212-230"},"PeriodicalIF":1.9000,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://bpspsychub.onlinelibrary.wiley.com/doi/epdf/10.1111/lcrp.12300","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Legal and Criminological Psychology","FirstCategoryId":"102","ListUrlMain":"https://bpspsychub.onlinelibrary.wiley.com/doi/10.1111/lcrp.12300","RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CRIMINOLOGY & PENOLOGY","Score":null,"Total":0}

引用次数: 0

Abstract

Purpose

Eyewitness memory research has reformed police practices and policy and is sometimes relied upon in legal proceedings. Due to the practical implications derived from this research, it is imperative to evaluate how practical recommendations are postulated. To assess the practical relevance of research, effect sizes and their interpretation play a pivotal role.

Methods

We examined how the frequently used effect size Area Under the Curve (AUC) obtained via Receiver Operating Characteristic (ROC) curves are used and interpreted in eyewitness memory research. We identified 157 eyewitness memory related articles that conducted ROC curve analyses resulting in 1580 AUCs.

Results

Approximately 90% of the AUCs were only interpreted via statistical significance. The majority of studies did not report 95%CIs for their AUCs. Finally, power analyses were frequently not conducted or not reproducible.

Conclusions

To improve the practical inferences of eyewitness memory research, we recommend establishing a smallest effect size of interest, focusing on 95%CIs, and conducting reproducible power analyses.

Abstract Image

查看原文本刊更多论文

曲线下受者工作特征面积在目击证人记忆研究中的应用

目击者记忆研究改革了警察的做法和政策，有时在法律诉讼中也有依据。由于这项研究的实际意义，有必要评估实际建议是如何假设的。为了评估研究的实际相关性，效应量及其解释起着关键作用。方法研究了在目击者记忆研究中如何使用和解释由受试者工作特征（ROC）曲线得到的常用效应大小曲线下面积（AUC）。我们确定了157篇目击者记忆相关的文章，进行了ROC曲线分析，得出1580个auc。结果约90%的auc只能通过统计学意义来解释。大多数研究没有报告其auc的95% ci。最后，功率分析经常不进行或不可重复。为了提高目击者记忆研究的实际推论，我们建议建立最小效应值，关注95%的ci，并进行可重复的功效分析。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Legal and Criminological Psychology Multiple-

CiteScore

4.00

自引率

4.30%

发文量

期刊介绍： Legal and Criminological Psychology publishes original papers in all areas of psychology and law: - victimology - policing and crime detection - crime prevention - management of offenders - mental health and the law - public attitudes to law - role of the expert witness - impact of law on behaviour - interviewing and eyewitness testimony - jury decision making - deception The journal publishes papers which advance professional and scientific knowledge defined broadly as the application of psychology to law and interdisciplinary enquiry in legal and psychological fields.