Performance Validity Test Failure in the Clinical Population: A Systematic Review and Meta-Analysis of Prevalence Rates.

IF 5.4 2区 心理学 Q1 NEUROSCIENCES
Neuropsychology Review Pub Date : 2024-03-01 Epub Date: 2023-03-06 DOI:10.1007/s11065-023-09582-7
Jeroen J Roor, Maarten J V Peters, Brechje Dandachi-FitzGerald, Rudolf W H M Ponds
{"title":"Performance Validity Test Failure in the Clinical Population: A Systematic Review and Meta-Analysis of Prevalence Rates.","authors":"Jeroen J Roor, Maarten J V Peters, Brechje Dandachi-FitzGerald, Rudolf W H M Ponds","doi":"10.1007/s11065-023-09582-7","DOIUrl":null,"url":null,"abstract":"<p><p>Performance validity tests (PVTs) are used to measure the validity of the obtained neuropsychological test data. However, when an individual fails a PVT, the likelihood that failure truly reflects invalid performance (i.e., the positive predictive value) depends on the base rate in the context in which the assessment takes place. Therefore, accurate base rate information is needed to guide interpretation of PVT performance. This systematic review and meta-analysis examined the base rate of PVT failure in the clinical population (PROSPERO number: CRD42020164128). PubMed/MEDLINE, Web of Science, and PsychINFO were searched to identify articles published up to November 5, 2021. Main eligibility criteria were a clinical evaluation context and utilization of stand-alone and well-validated PVTs. Of the 457 articles scrutinized for eligibility, 47 were selected for systematic review and meta-analyses. Pooled base rate of PVT failure for all included studies was 16%, 95% CI [14, 19]. High heterogeneity existed among these studies (Cochran's Q = 697.97, p < .001; I<sup>2</sup> = 91%; τ<sup>2</sup> = 0.08). Subgroup analysis indicated that pooled PVT failure rates varied across clinical context, presence of external incentives, clinical diagnosis, and utilized PVT. Our findings can be used for calculating clinically applied statistics (i.e., positive and negative predictive values, and likelihood ratios) to increase the diagnostic accuracy of performance validity determination in clinical evaluation. Future research is necessary with more detailed recruitment procedures and sample descriptions to further improve the accuracy of the base rate of PVT failure in clinical practice.</p>","PeriodicalId":49754,"journal":{"name":"Neuropsychology Review","volume":" ","pages":"299-319"},"PeriodicalIF":5.4000,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10920461/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neuropsychology Review","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1007/s11065-023-09582-7","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/3/6 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"NEUROSCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

Performance validity tests (PVTs) are used to measure the validity of the obtained neuropsychological test data. However, when an individual fails a PVT, the likelihood that failure truly reflects invalid performance (i.e., the positive predictive value) depends on the base rate in the context in which the assessment takes place. Therefore, accurate base rate information is needed to guide interpretation of PVT performance. This systematic review and meta-analysis examined the base rate of PVT failure in the clinical population (PROSPERO number: CRD42020164128). PubMed/MEDLINE, Web of Science, and PsychINFO were searched to identify articles published up to November 5, 2021. Main eligibility criteria were a clinical evaluation context and utilization of stand-alone and well-validated PVTs. Of the 457 articles scrutinized for eligibility, 47 were selected for systematic review and meta-analyses. Pooled base rate of PVT failure for all included studies was 16%, 95% CI [14, 19]. High heterogeneity existed among these studies (Cochran's Q = 697.97, p < .001; I2 = 91%; τ2 = 0.08). Subgroup analysis indicated that pooled PVT failure rates varied across clinical context, presence of external incentives, clinical diagnosis, and utilized PVT. Our findings can be used for calculating clinically applied statistics (i.e., positive and negative predictive values, and likelihood ratios) to increase the diagnostic accuracy of performance validity determination in clinical evaluation. Future research is necessary with more detailed recruitment procedures and sample descriptions to further improve the accuracy of the base rate of PVT failure in clinical practice.

Abstract Image

临床人群中的性能效度测试失败:流行率的系统回顾和元分析。
表现效度测试(PVT)是用来衡量所获得的神经心理测试数据的有效性。然而,当一个人未能通过 PVT 时,失败是否真正反映了无效表现(即阳性预测值)取决于评估背景下的基线率。因此,需要准确的基线率信息来指导对 PVT 表现的解释。本系统综述和荟萃分析研究了临床人群中 PVT 失败的基准率(PROSPERO 编号:CRD42020164128)。检索了 PubMed/MEDLINE、Web of Science 和 PsychINFO,以确定截至 2021 年 11 月 5 日发表的文章。主要的资格标准是临床评估背景和使用独立且经过充分验证的 PVT。在457篇经仔细审查符合条件的文章中,有47篇被选中进行系统综述和荟萃分析。所有纳入研究的 PVT 失败率汇总基数为 16%,95% CI [14、19]。这些研究之间存在高度异质性(Cochran's Q = 697.97,P 2 = 91%;τ2 = 0.08)。亚组分析表明,汇总的 PVT 失败率因临床环境、外部激励因素的存在、临床诊断和使用的 PVT 而异。我们的研究结果可用于计算临床应用统计量(即阳性预测值、阴性预测值和似然比),以提高临床评估中绩效有效性判定的诊断准确性。未来的研究需要更详细的招募程序和样本描述,以进一步提高临床实践中 PVT 失败基准率的准确性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Neuropsychology Review
Neuropsychology Review 医学-神经科学
CiteScore
11.00
自引率
1.70%
发文量
36
期刊介绍: Neuropsychology Review is a quarterly, refereed publication devoted to integrative review papers on substantive content areas in neuropsychology, with particular focus on populations with endogenous or acquired conditions affecting brain and function and on translational research providing a mechanistic understanding of clinical problems. Publication of new data is not the purview of the journal. Articles are written by international specialists in the field, discussing such complex issues as distinctive functional features of central nervous system disease and injury; challenges in early diagnosis; the impact of genes and environment on function; risk factors for functional impairment; treatment efficacy of neuropsychological rehabilitation; the role of neuroimaging, neuroelectrophysiology, and other neurometric modalities in explicating function; clinical trial design; neuropsychological function and its substrates characteristic of normal development and aging; and neuropsychological dysfunction and its substrates in neurological, psychiatric, and medical conditions. The journal''s broad perspective is supported by an outstanding, multidisciplinary editorial review board guided by the aim to provide students and professionals, clinicians and researchers with scholarly articles that critically and objectively summarize and synthesize the strengths and weaknesses in the literature and propose novel hypotheses, methods of analysis, and links to other fields.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信