Caitlin Reese, Jeff Schaffert, Oscar Kronenberger, Brittany Walls, Laura Lacritz
{"title":"将WMS-III逻辑记忆很少缺失指数(RMI)应用于WMS-IV:一项跨存档临床和标准化样本的研究","authors":"Caitlin Reese, Jeff Schaffert, Oscar Kronenberger, Brittany Walls, Laura Lacritz","doi":"10.1080/13803395.2025.2565200","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>Use of embedded performance validity tests (PVTs) helps efficiently monitor performance within neuropsychological batteries, particularly when embedded within instruments such as the Wechsler Memory Scale (WMS) Logical Memory (LM) subtest. Killgore and DellaPietra's 2000 commonly referenced WMS-III Rarely Missed Index (RMI) was developed through simulated design and not updated using WMS-IV items. This study investigated the utility of the WMS-III RMI in our clinical sample, while also seeking to validate a WMS-IV RMI update utilizing an archival Pearson non-stimulus sample (NSS) and our clinical archive.</p><p><strong>Method: </strong>Fifty cases from the Pearson NSS archive and clinic archive PVT Pass (<i>N</i> = 195) and Fail (<i>N</i> = 95) cases were included. Determination of PVT Pass-Fail was based on passing ≥2 stand-alone and/or embedded PVTs. The original RMI was updated using WMS-IV questions adapted from WMS-III. The novel WMS-IV RMI was developed by identifying LM recognition items answered with ≥ 70% accuracy in the Pearson NSS or ≥ 90% accuracy in the Pass-PVT group. Items entered into exploratory discriminant function analysis revealed a structure matrix with group correlation of ≥ 0.30, and standardized canonical discriminant function coefficients of 0.59, 0.46, 0.41, 0.33, and 0.23 for WMS-IV LM recognition items 14, 16, 22, 28, and 29, respectively. Items were weighted based on these coefficients, aggregating to an index ranging from 0 to 202.</p><p><strong>Results: </strong>Unexpectedly, no original RMI items overlapped with the novel RMI. The novel RMI cutoff of ≤140 resulted in 90.3% specificity with 25.3% sensitivity. Novel RMI AUC was 0.66, with an optimal cutoff of ≤190 to maximize sensitivity (64.2%) and specificity (65.4%).</p><p><strong>Conclusions: </strong>Results caution clinicians and researchers against using dated PVTs, while PVTs determined by simulated designs should not be assumed to stand up to clinical samples.</p>","PeriodicalId":15382,"journal":{"name":"Journal of clinical and experimental neuropsychology","volume":" ","pages":"1-10"},"PeriodicalIF":1.7000,"publicationDate":"2025-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Adapting the WMS-III Logical Memory Rarely Missing Index (RMI) to the WMS-IV: a study across archived clinical and standardization samples.\",\"authors\":\"Caitlin Reese, Jeff Schaffert, Oscar Kronenberger, Brittany Walls, Laura Lacritz\",\"doi\":\"10.1080/13803395.2025.2565200\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Introduction: </strong>Use of embedded performance validity tests (PVTs) helps efficiently monitor performance within neuropsychological batteries, particularly when embedded within instruments such as the Wechsler Memory Scale (WMS) Logical Memory (LM) subtest. Killgore and DellaPietra's 2000 commonly referenced WMS-III Rarely Missed Index (RMI) was developed through simulated design and not updated using WMS-IV items. This study investigated the utility of the WMS-III RMI in our clinical sample, while also seeking to validate a WMS-IV RMI update utilizing an archival Pearson non-stimulus sample (NSS) and our clinical archive.</p><p><strong>Method: </strong>Fifty cases from the Pearson NSS archive and clinic archive PVT Pass (<i>N</i> = 195) and Fail (<i>N</i> = 95) cases were included. Determination of PVT Pass-Fail was based on passing ≥2 stand-alone and/or embedded PVTs. The original RMI was updated using WMS-IV questions adapted from WMS-III. The novel WMS-IV RMI was developed by identifying LM recognition items answered with ≥ 70% accuracy in the Pearson NSS or ≥ 90% accuracy in the Pass-PVT group. Items entered into exploratory discriminant function analysis revealed a structure matrix with group correlation of ≥ 0.30, and standardized canonical discriminant function coefficients of 0.59, 0.46, 0.41, 0.33, and 0.23 for WMS-IV LM recognition items 14, 16, 22, 28, and 29, respectively. Items were weighted based on these coefficients, aggregating to an index ranging from 0 to 202.</p><p><strong>Results: </strong>Unexpectedly, no original RMI items overlapped with the novel RMI. The novel RMI cutoff of ≤140 resulted in 90.3% specificity with 25.3% sensitivity. Novel RMI AUC was 0.66, with an optimal cutoff of ≤190 to maximize sensitivity (64.2%) and specificity (65.4%).</p><p><strong>Conclusions: </strong>Results caution clinicians and researchers against using dated PVTs, while PVTs determined by simulated designs should not be assumed to stand up to clinical samples.</p>\",\"PeriodicalId\":15382,\"journal\":{\"name\":\"Journal of clinical and experimental neuropsychology\",\"volume\":\" \",\"pages\":\"1-10\"},\"PeriodicalIF\":1.7000,\"publicationDate\":\"2025-09-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of clinical and experimental neuropsychology\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1080/13803395.2025.2565200\",\"RegionNum\":4,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"CLINICAL NEUROLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of clinical and experimental neuropsychology","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1080/13803395.2025.2565200","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
Adapting the WMS-III Logical Memory Rarely Missing Index (RMI) to the WMS-IV: a study across archived clinical and standardization samples.
Introduction: Use of embedded performance validity tests (PVTs) helps efficiently monitor performance within neuropsychological batteries, particularly when embedded within instruments such as the Wechsler Memory Scale (WMS) Logical Memory (LM) subtest. Killgore and DellaPietra's 2000 commonly referenced WMS-III Rarely Missed Index (RMI) was developed through simulated design and not updated using WMS-IV items. This study investigated the utility of the WMS-III RMI in our clinical sample, while also seeking to validate a WMS-IV RMI update utilizing an archival Pearson non-stimulus sample (NSS) and our clinical archive.
Method: Fifty cases from the Pearson NSS archive and clinic archive PVT Pass (N = 195) and Fail (N = 95) cases were included. Determination of PVT Pass-Fail was based on passing ≥2 stand-alone and/or embedded PVTs. The original RMI was updated using WMS-IV questions adapted from WMS-III. The novel WMS-IV RMI was developed by identifying LM recognition items answered with ≥ 70% accuracy in the Pearson NSS or ≥ 90% accuracy in the Pass-PVT group. Items entered into exploratory discriminant function analysis revealed a structure matrix with group correlation of ≥ 0.30, and standardized canonical discriminant function coefficients of 0.59, 0.46, 0.41, 0.33, and 0.23 for WMS-IV LM recognition items 14, 16, 22, 28, and 29, respectively. Items were weighted based on these coefficients, aggregating to an index ranging from 0 to 202.
Results: Unexpectedly, no original RMI items overlapped with the novel RMI. The novel RMI cutoff of ≤140 resulted in 90.3% specificity with 25.3% sensitivity. Novel RMI AUC was 0.66, with an optimal cutoff of ≤190 to maximize sensitivity (64.2%) and specificity (65.4%).
Conclusions: Results caution clinicians and researchers against using dated PVTs, while PVTs determined by simulated designs should not be assumed to stand up to clinical samples.
期刊介绍:
Journal of Clinical and Experimental Neuropsychology ( JCEN) publishes research on the neuropsychological consequences of brain disease, disorders, and dysfunction, and aims to promote the integration of theories, methods, and research findings in clinical and experimental neuropsychology. The primary emphasis of JCEN is to publish original empirical research pertaining to brain-behavior relationships and neuropsychological manifestations of brain disease. Theoretical and methodological papers, critical reviews of content areas, and theoretically-relevant case studies are also welcome.