将言语配对联想和视觉再现识别试验的分类准确性复制为嵌入式性能有效性测试。

IF 2.6 3区 心理学 Q3 NEUROSCIENCES
Neuropsychology Pub Date : 2024-03-01 Epub Date: 2023-11-02 DOI:10.1037/neu0000934
Iulia Crisan, Natalie May, Luciano Giromini, Robert M Roth, Laszlo A Erdodi
{"title":"将言语配对联想和视觉再现识别试验的分类准确性复制为嵌入式性能有效性测试。","authors":"Iulia Crisan, Natalie May, Luciano Giromini, Robert M Roth, Laszlo A Erdodi","doi":"10.1037/neu0000934","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>This study was designed to replicate previous research on the clinical utility of the Verbal Paired Associates (VPA) and Visual Reproduction (VR) subtests of the WMS-IV as embedded performance validity tests (PVTs) and perform a critical item (CR) analysis within the VPA recognition trial.</p><p><strong>Method: </strong>Archival data were collected from a mixed clinical sample of 119 adults (<i>M</i><sub>Age</sub> = 42.5, <i>M</i><sub>Education</sub> = 13.9). Classification accuracy was computed against psychometrically defined criterion groups based on the outcome of various free-standing and embedded PVTs.</p><p><strong>Results: </strong>Age-corrected scaled scores ≤ 6 were specific (.89-.98) but had variable sensitivity (.36-.64). A VPA recognition cutoff of ≤ 34 produced a good combination of sensitivity (.46-.56) and specificity (.92-.93), as did a VR recognition cutoff of ≤ 4 (.48-.53 sensitivity at .86-.94 specificity). Critical item analysis expanded the VPA's sensitivity by 3.5%-7.0% and specificity by 5%-8%. Negative learning curves (declining output on subsequent encoding trials) were rare but highly specific (.99-1.00) to noncredible responding.</p><p><strong>Conclusions: </strong>Results largely support previous reports on the clinical utility of the VPA and VR as embedded PVTs. Sample-specific fluctuations in their classification accuracy warrant further research into the generalizability of the findings. Critical item analysis offers a cost-effective method for increasing confidence in the interpretation of the VPA recognition trial as a PVT. (PsycInfo Database Record (c) 2024 APA, all rights reserved).</p>","PeriodicalId":19205,"journal":{"name":"Neuropsychology","volume":" ","pages":"281-292"},"PeriodicalIF":2.6000,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Replicating the classification accuracy of the Verbal Paired Associates and Visual Reproduction recognition trials as embedded performance validity tests.\",\"authors\":\"Iulia Crisan, Natalie May, Luciano Giromini, Robert M Roth, Laszlo A Erdodi\",\"doi\":\"10.1037/neu0000934\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objective: </strong>This study was designed to replicate previous research on the clinical utility of the Verbal Paired Associates (VPA) and Visual Reproduction (VR) subtests of the WMS-IV as embedded performance validity tests (PVTs) and perform a critical item (CR) analysis within the VPA recognition trial.</p><p><strong>Method: </strong>Archival data were collected from a mixed clinical sample of 119 adults (<i>M</i><sub>Age</sub> = 42.5, <i>M</i><sub>Education</sub> = 13.9). Classification accuracy was computed against psychometrically defined criterion groups based on the outcome of various free-standing and embedded PVTs.</p><p><strong>Results: </strong>Age-corrected scaled scores ≤ 6 were specific (.89-.98) but had variable sensitivity (.36-.64). A VPA recognition cutoff of ≤ 34 produced a good combination of sensitivity (.46-.56) and specificity (.92-.93), as did a VR recognition cutoff of ≤ 4 (.48-.53 sensitivity at .86-.94 specificity). Critical item analysis expanded the VPA's sensitivity by 3.5%-7.0% and specificity by 5%-8%. Negative learning curves (declining output on subsequent encoding trials) were rare but highly specific (.99-1.00) to noncredible responding.</p><p><strong>Conclusions: </strong>Results largely support previous reports on the clinical utility of the VPA and VR as embedded PVTs. Sample-specific fluctuations in their classification accuracy warrant further research into the generalizability of the findings. Critical item analysis offers a cost-effective method for increasing confidence in the interpretation of the VPA recognition trial as a PVT. (PsycInfo Database Record (c) 2024 APA, all rights reserved).</p>\",\"PeriodicalId\":19205,\"journal\":{\"name\":\"Neuropsychology\",\"volume\":\" \",\"pages\":\"281-292\"},\"PeriodicalIF\":2.6000,\"publicationDate\":\"2024-03-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Neuropsychology\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1037/neu0000934\",\"RegionNum\":3,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2023/11/2 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q3\",\"JCRName\":\"NEUROSCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neuropsychology","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/neu0000934","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/11/2 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"NEUROSCIENCES","Score":null,"Total":0}
引用次数: 0

摘要

目的:本研究旨在复制先前关于WMS-IV的言语配对联想(VPA)和视觉再现(VR)子测验作为嵌入式性能有效性测试(PVT)的临床效用的研究,并在VPA识别试验中进行关键项目(CR)分析。方法:从119名成人的混合临床样本中收集档案数据(MAge=42.5,MEEducation=13.9)。根据各种独立和嵌入式PVT的结果,根据心理测量学定义的标准组计算分类准确性。结果:年龄校正量表评分≤6是特异性的(.89-.98),但具有可变的敏感性(.36-.64)≤34产生了灵敏度(.46-.56)和特异性(.92-.93)的良好组合,VR识别临界值≤4(.48-.53灵敏度,.86-.94特异性)也是如此。关键项目分析使VPA的敏感性提高了3.5%-7.0%,特异性提高了5%-8%。负学习曲线(在随后的编码试验中输出下降)是罕见的,但对不可预测的反应具有高度特异性(.99-1.00)。结论:研究结果在很大程度上支持了先前关于VPA和VR作为嵌入式PVT的临床应用的报道。样本分类准确性的具体波动需要对研究结果的可推广性进行进一步研究。关键项目分析提供了一种成本效益高的方法,可以提高对VPA识别试验作为PVT的解释的信心。(PsycInfo数据库记录(c)2023 APA,保留所有权利)。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Replicating the classification accuracy of the Verbal Paired Associates and Visual Reproduction recognition trials as embedded performance validity tests.

Objective: This study was designed to replicate previous research on the clinical utility of the Verbal Paired Associates (VPA) and Visual Reproduction (VR) subtests of the WMS-IV as embedded performance validity tests (PVTs) and perform a critical item (CR) analysis within the VPA recognition trial.

Method: Archival data were collected from a mixed clinical sample of 119 adults (MAge = 42.5, MEducation = 13.9). Classification accuracy was computed against psychometrically defined criterion groups based on the outcome of various free-standing and embedded PVTs.

Results: Age-corrected scaled scores ≤ 6 were specific (.89-.98) but had variable sensitivity (.36-.64). A VPA recognition cutoff of ≤ 34 produced a good combination of sensitivity (.46-.56) and specificity (.92-.93), as did a VR recognition cutoff of ≤ 4 (.48-.53 sensitivity at .86-.94 specificity). Critical item analysis expanded the VPA's sensitivity by 3.5%-7.0% and specificity by 5%-8%. Negative learning curves (declining output on subsequent encoding trials) were rare but highly specific (.99-1.00) to noncredible responding.

Conclusions: Results largely support previous reports on the clinical utility of the VPA and VR as embedded PVTs. Sample-specific fluctuations in their classification accuracy warrant further research into the generalizability of the findings. Critical item analysis offers a cost-effective method for increasing confidence in the interpretation of the VPA recognition trial as a PVT. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Neuropsychology
Neuropsychology 医学-神经科学
CiteScore
4.10
自引率
4.20%
发文量
132
审稿时长
6-12 weeks
期刊介绍: Neuropsychology publishes original, empirical research; systematic reviews and meta-analyses; and theoretical articles on the relation between brain and human cognitive, emotional, and behavioral function.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信