Replicating the classification accuracy of the Verbal Paired Associates and Visual Reproduction recognition trials as embedded performance validity tests.

IF 2.6 3区心理学 Q3 NEUROSCIENCES

Neuropsychology Pub Date : 2024-03-01 Epub Date: 2023-11-02 DOI:10.1037/neu0000934

Iulia Crisan, Natalie May, Luciano Giromini, Robert M Roth, Laszlo A Erdodi

{"title":"Replicating the classification accuracy of the Verbal Paired Associates and Visual Reproduction recognition trials as embedded performance validity tests.","authors":"Iulia Crisan, Natalie May, Luciano Giromini, Robert M Roth, Laszlo A Erdodi","doi":"10.1037/neu0000934","DOIUrl":null,"url":null,"abstract":"Objective: This study was designed to replicate previous research on the clinical utility of the Verbal Paired Associates (VPA) and Visual Reproduction (VR) subtests of the WMS-IV as embedded performance validity tests (PVTs) and perform a critical item (CR) analysis within the VPA recognition trial.Method: Archival data were collected from a mixed clinical sample of 119 adults (MAge = 42.5, MEducation = 13.9). Classification accuracy was computed against psychometrically defined criterion groups based on the outcome of various free-standing and embedded PVTs.Results: Age-corrected scaled scores ≤ 6 were specific (.89-.98) but had variable sensitivity (.36-.64). A VPA recognition cutoff of ≤ 34 produced a good combination of sensitivity (.46-.56) and specificity (.92-.93), as did a VR recognition cutoff of ≤ 4 (.48-.53 sensitivity at .86-.94 specificity). Critical item analysis expanded the VPA's sensitivity by 3.5%-7.0% and specificity by 5%-8%. Negative learning curves (declining output on subsequent encoding trials) were rare but highly specific (.99-1.00) to noncredible responding.Conclusions: Results largely support previous reports on the clinical utility of the VPA and VR as embedded PVTs. Sample-specific fluctuations in their classification accuracy warrant further research into the generalizability of the findings. Critical item analysis offers a cost-effective method for increasing confidence in the interpretation of the VPA recognition trial as a PVT. (PsycInfo Database Record (c) 2024 APA, all rights reserved).","PeriodicalId":19205,"journal":{"name":"Neuropsychology","volume":" ","pages":"281-292"},"PeriodicalIF":2.6000,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neuropsychology","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/neu0000934","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/11/2 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"NEUROSCIENCES","Score":null,"Total":0}

引用次数: 0

Abstract

Objective: This study was designed to replicate previous research on the clinical utility of the Verbal Paired Associates (VPA) and Visual Reproduction (VR) subtests of the WMS-IV as embedded performance validity tests (PVTs) and perform a critical item (CR) analysis within the VPA recognition trial.

Method: Archival data were collected from a mixed clinical sample of 119 adults (M_Age = 42.5, M_Education = 13.9). Classification accuracy was computed against psychometrically defined criterion groups based on the outcome of various free-standing and embedded PVTs.

Results: Age-corrected scaled scores ≤ 6 were specific (.89-.98) but had variable sensitivity (.36-.64). A VPA recognition cutoff of ≤ 34 produced a good combination of sensitivity (.46-.56) and specificity (.92-.93), as did a VR recognition cutoff of ≤ 4 (.48-.53 sensitivity at .86-.94 specificity). Critical item analysis expanded the VPA's sensitivity by 3.5%-7.0% and specificity by 5%-8%. Negative learning curves (declining output on subsequent encoding trials) were rare but highly specific (.99-1.00) to noncredible responding.

Conclusions: Results largely support previous reports on the clinical utility of the VPA and VR as embedded PVTs. Sample-specific fluctuations in their classification accuracy warrant further research into the generalizability of the findings. Critical item analysis offers a cost-effective method for increasing confidence in the interpretation of the VPA recognition trial as a PVT. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

查看原文本刊更多论文

将言语配对联想和视觉再现识别试验的分类准确性复制为嵌入式性能有效性测试。

目的：本研究旨在复制先前关于WMS-IV的言语配对联想（VPA）和视觉再现（VR）子测验作为嵌入式性能有效性测试（PVT）的临床效用的研究，并在VPA识别试验中进行关键项目（CR）分析。方法：从119名成人的混合临床样本中收集档案数据（MAge=42.5，MEEducation=13.9）。根据各种独立和嵌入式PVT的结果，根据心理测量学定义的标准组计算分类准确性。结果：年龄校正量表评分≤6是特异性的（.89-.98），但具有可变的敏感性（.36-.64）≤34产生了灵敏度（.46-.56）和特异性（.92-.93）的良好组合，VR识别临界值≤4（.48-.53灵敏度，.86-.94特异性）也是如此。关键项目分析使VPA的敏感性提高了3.5%-7.0%，特异性提高了5%-8%。负学习曲线（在随后的编码试验中输出下降）是罕见的，但对不可预测的反应具有高度特异性（.99-1.00）。结论：研究结果在很大程度上支持了先前关于VPA和VR作为嵌入式PVT的临床应用的报道。样本分类准确性的具体波动需要对研究结果的可推广性进行进一步研究。关键项目分析提供了一种成本效益高的方法，可以提高对VPA识别试验作为PVT的解释的信心。（PsycInfo数据库记录（c）2023 APA，保留所有权利）。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Neuropsychology 医学-神经科学

CiteScore

4.10

自引率

4.20%

发文量

132

审稿时长

6-12 weeks

期刊介绍： Neuropsychology publishes original, empirical research; systematic reviews and meta-analyses; and theoretical articles on the relation between brain and human cognitive, emotional, and behavioral function.