Statistical reporting practices within forensic psychology: Is anything changing?

IF 2.4 2区 社会学 Q1 LAW
Joseph Eastwood,Kirk Luther,Tianshuang Han,Valerie Arenzon,Quintan Crough,Ashley Curtis,Hannah de Almeida,Kelsey Janet Downer,Cassandre Dion Larivière,Jessica Lundy,Funmilola Ogunseye,Mark D Snow,Brent Snook
{"title":"Statistical reporting practices within forensic psychology: Is anything changing?","authors":"Joseph Eastwood,Kirk Luther,Tianshuang Han,Valerie Arenzon,Quintan Crough,Ashley Curtis,Hannah de Almeida,Kelsey Janet Downer,Cassandre Dion Larivière,Jessica Lundy,Funmilola Ogunseye,Mark D Snow,Brent Snook","doi":"10.1037/lhb0000611","DOIUrl":null,"url":null,"abstract":"OBJECTIVE\r\nWe examined the evolution of statistical reporting practices within forensic psychology across two decades (2000-2020) to assess their adherence to recommended best practices.\r\n\r\nMETHOD\r\nWe conducted a comprehensive analysis of articles published in six prominent forensic psychology journals, including every empirical article published in each journal in 2000, 2005, 2010, 2015, and 2020 (N = 813). We then evaluated the use and interpretation of null hypothesis significance testing (NHST), effect sizes (ESs), confidence intervals (CIs), and Bayesian statistics for each article in the sample.\r\n\r\nRESULTS\r\nWe found a persistent reliance on NHST, with nearly all articles employing it for data analysis and interpretation. Encouragingly, the reporting of ESs and CIs has increased substantially; their interpretative use, however, remains limited. Bayesian methods were rarely used for analysis or interpretation of data.\r\n\r\nCONCLUSIONS\r\nThese findings suggest a slow uptake of reforms advocated by statistical guidelines, with forensic psychology researchers continuing to prioritize NHST over recommended approaches. Although the increase in ES and CI reporting is encouraging, the continued reliance on NHST means that both the scientific literature and important applied decision making in the forensic psychology field are impacted by the shortcomings of this statistical reporting approach (e.g., simplistic dichotomous decisions, lack of reproducibility, potential for p-hacking). We call for journals in the field to encourage further use of statistical best practices within their manuscripts. (PsycInfo Database Record (c) 2025 APA, all rights reserved).","PeriodicalId":48230,"journal":{"name":"Law and Human Behavior","volume":"47 1","pages":""},"PeriodicalIF":2.4000,"publicationDate":"2025-05-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Law and Human Behavior","FirstCategoryId":"90","ListUrlMain":"https://doi.org/10.1037/lhb0000611","RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"LAW","Score":null,"Total":0}
引用次数: 0

Abstract

OBJECTIVE We examined the evolution of statistical reporting practices within forensic psychology across two decades (2000-2020) to assess their adherence to recommended best practices. METHOD We conducted a comprehensive analysis of articles published in six prominent forensic psychology journals, including every empirical article published in each journal in 2000, 2005, 2010, 2015, and 2020 (N = 813). We then evaluated the use and interpretation of null hypothesis significance testing (NHST), effect sizes (ESs), confidence intervals (CIs), and Bayesian statistics for each article in the sample. RESULTS We found a persistent reliance on NHST, with nearly all articles employing it for data analysis and interpretation. Encouragingly, the reporting of ESs and CIs has increased substantially; their interpretative use, however, remains limited. Bayesian methods were rarely used for analysis or interpretation of data. CONCLUSIONS These findings suggest a slow uptake of reforms advocated by statistical guidelines, with forensic psychology researchers continuing to prioritize NHST over recommended approaches. Although the increase in ES and CI reporting is encouraging, the continued reliance on NHST means that both the scientific literature and important applied decision making in the forensic psychology field are impacted by the shortcomings of this statistical reporting approach (e.g., simplistic dichotomous decisions, lack of reproducibility, potential for p-hacking). We call for journals in the field to encourage further use of statistical best practices within their manuscripts. (PsycInfo Database Record (c) 2025 APA, all rights reserved).
司法心理学中的统计报告实践:有什么变化吗?
目的:我们研究了20年来(2000-2020年)法医心理学统计报告实践的演变,以评估他们对推荐的最佳实践的依从性。方法对2000年、2005年、2010年、2015年和2020年发表在6家著名法医心理学期刊上的实证文章进行综合分析(N = 813)。然后,我们评估了样本中每篇文章的零假设显著性检验(NHST)、效应量(ESs)、置信区间(CIs)和贝叶斯统计的使用和解释。结果我们发现对NHST的持续依赖,几乎所有的文章都使用它进行数据分析和解释。令人鼓舞的是,企业环境评估和企业信息评估的报告数量大幅增加;然而,它们的解释性用途仍然有限。贝叶斯方法很少用于数据的分析或解释。这些发现表明统计指南倡导的改革进展缓慢,法医心理学研究人员继续优先考虑NHST而不是推荐的方法。尽管ES和CI报告的增加令人鼓舞,但对NHST的持续依赖意味着科学文献和法医心理学领域的重要应用决策都受到了这种统计报告方法的缺点的影响(例如,简单的二分法决策,缺乏可重复性,p-hacking的潜力)。我们呼吁该领域的期刊鼓励在其稿件中进一步使用统计最佳实践。(PsycInfo Database Record (c) 2025 APA,版权所有)。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
4.50
自引率
8.00%
发文量
42
期刊介绍: Law and Human Behavior, the official journal of the American Psychology-Law Society/Division 41 of the American Psychological Association, is a multidisciplinary forum for the publication of articles and discussions of issues arising out of the relationships between human behavior and the law, our legal system, and the legal process. This journal publishes original research, reviews of past research, and theoretical studies from professionals in criminal justice, law, psychology, sociology, psychiatry, political science, education, communication, and other areas germane to the field.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信