Matthew S Phillips, Amanda M Wisinger, Brian M Cerny, Humza Khan, Fini Chang, Ka Yin Phoebe Tse, Gabriel P Ovsiew, Zachary J Resch, Greg Shapiro, Jason R Soble, Kyle J Jennette
{"title":"处理速度和记忆能力对混合神经精神病样本点计数测试分类准确性的影响。","authors":"Matthew S Phillips, Amanda M Wisinger, Brian M Cerny, Humza Khan, Fini Chang, Ka Yin Phoebe Tse, Gabriel P Ovsiew, Zachary J Resch, Greg Shapiro, Jason R Soble, Kyle J Jennette","doi":"10.1080/13803395.2024.2363978","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>This study examined the impact of impairment in two specific cognitive abilities, processing speed and memory, on Dot Counting Test (DCT) classification accuracy by evaluating performance validity classification accuracy across cognitively unimpaired, single-domain impairment, and multidomain impairment subgroups within a mixed clinical sample.</p><p><strong>Method: </strong>Cross-sectional data were analyzed from 348 adult outpatients classified as valid (<i>n</i> = 284) or invalid (<i>n</i> = 64) based on four independent criterion performance validity tests (PVTs). Unimpaired (<i>n</i> = 164), single-domain processing speed impairment (<i>n</i> = 24), single-domain memory impairment (<i>n</i> = 53), and multidomain processing speed and memory impairment (<i>n</i> = 43) clinical subgroups were established among the valid group. Both the traditional DCT E-score and unrounded E-score were examined.</p><p><strong>Results: </strong>Overall, the DCT demonstrated acceptable to excellent classification accuracy across the unimpaired (area under the curve [AUC] traditional E-score=.855; unrounded E-score=.855) and single-domain impairment groups (traditional E-score AUCs = .690-.754; unrounded E-score AUCs = .692-747). However, it did not reliably discriminate the multidomain processing speed and memory impairment group from the invalid performers (traditional and unrounded E-scores AUC = .557).</p><p><strong>Conclusions: </strong>Findings support the DCT as a non-memory-based freestanding PVT for use with single-domain cognitive impairment, with traditional E-score ≥17 (unrounded E-score ≥16.95) recommended for those with memory impairment and traditional E-score ≥19 (unrounded ≥18.08) with processing speed impairment. Moreover, results replicated previously established optimal cutoffs for unimpaired groups using both the traditional (≥14) and unrounded (≥13.84) E-scores. However, the DCT did not reliably discriminate between invalid performance and multidomain cognitive impairment, indicating caution is warranted when using the DCT with patients suspected of greater cognitive impairment.</p>","PeriodicalId":15382,"journal":{"name":"Journal of clinical and experimental neuropsychology","volume":null,"pages":null},"PeriodicalIF":1.8000,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Effect of processing speed and memory performance on classification accuracy of the dot counting test in a mixed neuropsychiatric sample.\",\"authors\":\"Matthew S Phillips, Amanda M Wisinger, Brian M Cerny, Humza Khan, Fini Chang, Ka Yin Phoebe Tse, Gabriel P Ovsiew, Zachary J Resch, Greg Shapiro, Jason R Soble, Kyle J Jennette\",\"doi\":\"10.1080/13803395.2024.2363978\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Objective: </strong>This study examined the impact of impairment in two specific cognitive abilities, processing speed and memory, on Dot Counting Test (DCT) classification accuracy by evaluating performance validity classification accuracy across cognitively unimpaired, single-domain impairment, and multidomain impairment subgroups within a mixed clinical sample.</p><p><strong>Method: </strong>Cross-sectional data were analyzed from 348 adult outpatients classified as valid (<i>n</i> = 284) or invalid (<i>n</i> = 64) based on four independent criterion performance validity tests (PVTs). Unimpaired (<i>n</i> = 164), single-domain processing speed impairment (<i>n</i> = 24), single-domain memory impairment (<i>n</i> = 53), and multidomain processing speed and memory impairment (<i>n</i> = 43) clinical subgroups were established among the valid group. Both the traditional DCT E-score and unrounded E-score were examined.</p><p><strong>Results: </strong>Overall, the DCT demonstrated acceptable to excellent classification accuracy across the unimpaired (area under the curve [AUC] traditional E-score=.855; unrounded E-score=.855) and single-domain impairment groups (traditional E-score AUCs = .690-.754; unrounded E-score AUCs = .692-747). However, it did not reliably discriminate the multidomain processing speed and memory impairment group from the invalid performers (traditional and unrounded E-scores AUC = .557).</p><p><strong>Conclusions: </strong>Findings support the DCT as a non-memory-based freestanding PVT for use with single-domain cognitive impairment, with traditional E-score ≥17 (unrounded E-score ≥16.95) recommended for those with memory impairment and traditional E-score ≥19 (unrounded ≥18.08) with processing speed impairment. Moreover, results replicated previously established optimal cutoffs for unimpaired groups using both the traditional (≥14) and unrounded (≥13.84) E-scores. However, the DCT did not reliably discriminate between invalid performance and multidomain cognitive impairment, indicating caution is warranted when using the DCT with patients suspected of greater cognitive impairment.</p>\",\"PeriodicalId\":15382,\"journal\":{\"name\":\"Journal of clinical and experimental neuropsychology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.8000,\"publicationDate\":\"2024-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of clinical and experimental neuropsychology\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1080/13803395.2024.2363978\",\"RegionNum\":4,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/6/7 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q3\",\"JCRName\":\"CLINICAL NEUROLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of clinical and experimental neuropsychology","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1080/13803395.2024.2363978","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/6/7 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
Effect of processing speed and memory performance on classification accuracy of the dot counting test in a mixed neuropsychiatric sample.
Objective: This study examined the impact of impairment in two specific cognitive abilities, processing speed and memory, on Dot Counting Test (DCT) classification accuracy by evaluating performance validity classification accuracy across cognitively unimpaired, single-domain impairment, and multidomain impairment subgroups within a mixed clinical sample.
Method: Cross-sectional data were analyzed from 348 adult outpatients classified as valid (n = 284) or invalid (n = 64) based on four independent criterion performance validity tests (PVTs). Unimpaired (n = 164), single-domain processing speed impairment (n = 24), single-domain memory impairment (n = 53), and multidomain processing speed and memory impairment (n = 43) clinical subgroups were established among the valid group. Both the traditional DCT E-score and unrounded E-score were examined.
Results: Overall, the DCT demonstrated acceptable to excellent classification accuracy across the unimpaired (area under the curve [AUC] traditional E-score=.855; unrounded E-score=.855) and single-domain impairment groups (traditional E-score AUCs = .690-.754; unrounded E-score AUCs = .692-747). However, it did not reliably discriminate the multidomain processing speed and memory impairment group from the invalid performers (traditional and unrounded E-scores AUC = .557).
Conclusions: Findings support the DCT as a non-memory-based freestanding PVT for use with single-domain cognitive impairment, with traditional E-score ≥17 (unrounded E-score ≥16.95) recommended for those with memory impairment and traditional E-score ≥19 (unrounded ≥18.08) with processing speed impairment. Moreover, results replicated previously established optimal cutoffs for unimpaired groups using both the traditional (≥14) and unrounded (≥13.84) E-scores. However, the DCT did not reliably discriminate between invalid performance and multidomain cognitive impairment, indicating caution is warranted when using the DCT with patients suspected of greater cognitive impairment.
期刊介绍:
Journal of Clinical and Experimental Neuropsychology ( JCEN) publishes research on the neuropsychological consequences of brain disease, disorders, and dysfunction, and aims to promote the integration of theories, methods, and research findings in clinical and experimental neuropsychology. The primary emphasis of JCEN is to publish original empirical research pertaining to brain-behavior relationships and neuropsychological manifestations of brain disease. Theoretical and methodological papers, critical reviews of content areas, and theoretically-relevant case studies are also welcome.