Review of Statistical and Methodological Issues in the Forensic Prediction of Malingering from Validity Tests: Part I: Statistical Issues.

IF 5.4 2区 心理学 Q1 NEUROSCIENCES
Neuropsychology Review Pub Date : 2023-09-01 Epub Date: 2023-08-24 DOI:10.1007/s11065-023-09601-7
Christoph Leonhard
{"title":"Review of Statistical and Methodological Issues in the Forensic Prediction of Malingering from Validity Tests: Part I: Statistical Issues.","authors":"Christoph Leonhard","doi":"10.1007/s11065-023-09601-7","DOIUrl":null,"url":null,"abstract":"<p><p>Forensic neuropsychological examinations with determination of malingering have tremendous social, legal, and economic consequences. Thousands of studies have been published aimed at developing and validating methods to diagnose malingering in forensic settings, based largely on approximately 50 validity tests, including embedded and stand-alone performance validity tests. This is the first part of a two-part review. Part I explores three statistical issues related to the validation of validity tests as predictors of malingering, including (a) the need to report a complete set of classification accuracy statistics, (b) how to detect and handle collinearity among validity tests, and (c) how to assess the classification accuracy of algorithms for aggregating information from multiple validity tests. In the Part II companion paper, three closely related research methodological issues will be examined. Statistical issues are explored through conceptual analysis, statistical simulations, and through reanalysis of findings from prior validation studies. Findings suggest extant neuropsychological validity tests are collinear and contribute redundant information to the prediction of malingering among forensic examinees. Findings further suggest that existing diagnostic algorithms may miss diagnostic accuracy targets under most realistic conditions. The review makes several recommendations to address these concerns, including (a) reporting of full confusion table statistics with 95% confidence intervals in diagnostic trials, (b) the use of logistic regression, and (c) adoption of the consensus model on the \"transparent reporting of multivariate prediction models for individual prognosis or diagnosis\" (TRIPOD) in the malingering literature.</p>","PeriodicalId":49754,"journal":{"name":"Neuropsychology Review","volume":null,"pages":null},"PeriodicalIF":5.4000,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neuropsychology Review","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1007/s11065-023-09601-7","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/8/24 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"NEUROSCIENCES","Score":null,"Total":0}
引用次数: 1

Abstract

Forensic neuropsychological examinations with determination of malingering have tremendous social, legal, and economic consequences. Thousands of studies have been published aimed at developing and validating methods to diagnose malingering in forensic settings, based largely on approximately 50 validity tests, including embedded and stand-alone performance validity tests. This is the first part of a two-part review. Part I explores three statistical issues related to the validation of validity tests as predictors of malingering, including (a) the need to report a complete set of classification accuracy statistics, (b) how to detect and handle collinearity among validity tests, and (c) how to assess the classification accuracy of algorithms for aggregating information from multiple validity tests. In the Part II companion paper, three closely related research methodological issues will be examined. Statistical issues are explored through conceptual analysis, statistical simulations, and through reanalysis of findings from prior validation studies. Findings suggest extant neuropsychological validity tests are collinear and contribute redundant information to the prediction of malingering among forensic examinees. Findings further suggest that existing diagnostic algorithms may miss diagnostic accuracy targets under most realistic conditions. The review makes several recommendations to address these concerns, including (a) reporting of full confusion table statistics with 95% confidence intervals in diagnostic trials, (b) the use of logistic regression, and (c) adoption of the consensus model on the "transparent reporting of multivariate prediction models for individual prognosis or diagnosis" (TRIPOD) in the malingering literature.

Abstract Image

从有效性测试中法医学预测危害的统计和方法论问题综述:第一部分:统计问题。
确定装病的法医神经心理学检查具有巨大的社会、法律和经济后果。已经发表了数千项研究,旨在开发和验证在法医环境中诊断装病的方法,主要基于大约50项有效性测试,包括嵌入式和独立的性能有效性测试。这是由两部分组成的综述的第一部分。第一部分探讨了与验证有效性测试作为造假预测因素相关的三个统计问题,包括(a)需要报告一套完整的分类准确性统计数据,(b)如何检测和处理有效性测试之间的共线性,以及(c)如何评估聚合多个有效性测试信息的算法的分类准确性。在第二部分的配套论文中,将研究三个密切相关的研究方法论问题。通过概念分析、统计模拟和对先前验证研究结果的再分析来探讨统计问题。研究结果表明,现存的神经心理学有效性测试是共线的,并为预测法医考生的装病提供了冗余信息。研究结果进一步表明,在最现实的条件下,现有的诊断算法可能会错过诊断准确性目标。该综述提出了一些解决这些问题的建议,包括(a)在诊断试验中报告95%置信区间的完全混淆表统计数据,(b)使用逻辑回归,以及(c)在装病文献中采用关于“个人预后或诊断的多变量预测模型的透明报告”(TRIPOD)的共识模型。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Neuropsychology Review
Neuropsychology Review 医学-神经科学
CiteScore
11.00
自引率
1.70%
发文量
36
期刊介绍: Neuropsychology Review is a quarterly, refereed publication devoted to integrative review papers on substantive content areas in neuropsychology, with particular focus on populations with endogenous or acquired conditions affecting brain and function and on translational research providing a mechanistic understanding of clinical problems. Publication of new data is not the purview of the journal. Articles are written by international specialists in the field, discussing such complex issues as distinctive functional features of central nervous system disease and injury; challenges in early diagnosis; the impact of genes and environment on function; risk factors for functional impairment; treatment efficacy of neuropsychological rehabilitation; the role of neuroimaging, neuroelectrophysiology, and other neurometric modalities in explicating function; clinical trial design; neuropsychological function and its substrates characteristic of normal development and aging; and neuropsychological dysfunction and its substrates in neurological, psychiatric, and medical conditions. The journal''s broad perspective is supported by an outstanding, multidisciplinary editorial review board guided by the aim to provide students and professionals, clinicians and researchers with scholarly articles that critically and objectively summarize and synthesize the strengths and weaknesses in the literature and propose novel hypotheses, methods of analysis, and links to other fields.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信