Comparative analysis of sensitivity and specificity of computer-aided cognitive test in screening mild cognitive impairment patients and test of reliability and validity.

IF 1.7 4区心理学

Applied Neuropsychology-Adult Pub Date : 2024-11-01 Epub Date: 2022-10-11 DOI:10.1080/23279095.2022.2130317

Jing Ma, Renren Li, Wei Zhang, Lihe Huang, Xing Wang, Yusheng He, Shasha Jin, Meng Liu, Jiequn Wang, Weixin Xiao, Zengmai Xie, Zheng Lu, Zhiyu Nie, Yunxia Li

{"title":"Comparative analysis of sensitivity and specificity of computer-aided cognitive test in screening mild cognitive impairment patients and test of reliability and validity.","authors":"Jing Ma, Renren Li, Wei Zhang, Lihe Huang, Xing Wang, Yusheng He, Shasha Jin, Meng Liu, Jiequn Wang, Weixin Xiao, Zengmai Xie, Zheng Lu, Zhiyu Nie, Yunxia Li","doi":"10.1080/23279095.2022.2130317","DOIUrl":null,"url":null,"abstract":"Objectives: To evaluate the reliability and validity of the computer-aided cognitive test (CACT).Methods: 219 Subjects of Tongji Hospital's Brain Health cohort (115 cases of Mild Cognitive Impairment (MCI) patients and 104 cases of normal controls) were enrolled, of which 24 cases received a retest after 2 weeks. Finally, the reliability and validity of the scale were tested and analyzed.Results: (1) Reliability: (a) the internal consistency reliability of the total score of the scale was 0.645; (b) the retest reliability correlation coefficient of the total score of the scale was 0.900; (c) the Guttman Split-Half coefficient was 0.631; (2) Validity: (a) construct validity analysis showed that the correlation coefficient between each section score was between 0.036 and 0.408, and the correlation coefficient between each section score and the total score was between 0.468 and 0.781; (b) criterion validity analysis showed that the correlation coefficient between the total score of CACT and that of the Mini Mental State Examination (MMSE) was 0.733, and the coefficient between the total score of CACT and that of the basic version of the Montreal Cognitive Assessment (MoCA) was 0.763; (c) the area under the ROC curve of the CACT to distinguish between MCI patients and controls was 0.920, with an optimal diagnostic threshold of 20, a sensitivity of 88.5%, and a specificity of 80.9%.Conclusion: The CACT is little influenced by education level. It has good reliability and validity, which can be used for early clinical screening of cognitive dysfunction.","PeriodicalId":50741,"journal":{"name":"Applied Neuropsychology-Adult","volume":" ","pages":"1391-1397"},"PeriodicalIF":1.7000,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Neuropsychology-Adult","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1080/23279095.2022.2130317","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2022/10/11 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 0

Abstract

Objectives: To evaluate the reliability and validity of the computer-aided cognitive test (CACT).

Methods: 219 Subjects of Tongji Hospital's Brain Health cohort (115 cases of Mild Cognitive Impairment (MCI) patients and 104 cases of normal controls) were enrolled, of which 24 cases received a retest after 2 weeks. Finally, the reliability and validity of the scale were tested and analyzed.

Results: (1) Reliability: (a) the internal consistency reliability of the total score of the scale was 0.645; (b) the retest reliability correlation coefficient of the total score of the scale was 0.900; (c) the Guttman Split-Half coefficient was 0.631; (2) Validity: (a) construct validity analysis showed that the correlation coefficient between each section score was between 0.036 and 0.408, and the correlation coefficient between each section score and the total score was between 0.468 and 0.781; (b) criterion validity analysis showed that the correlation coefficient between the total score of CACT and that of the Mini Mental State Examination (MMSE) was 0.733, and the coefficient between the total score of CACT and that of the basic version of the Montreal Cognitive Assessment (MoCA) was 0.763; (c) the area under the ROC curve of the CACT to distinguish between MCI patients and controls was 0.920, with an optimal diagnostic threshold of 20, a sensitivity of 88.5%, and a specificity of 80.9%.

Conclusion: The CACT is little influenced by education level. It has good reliability and validity, which can be used for early clinical screening of cognitive dysfunction.

查看原文本刊更多论文

计算机辅助认知测试在筛查轻度认知障碍患者方面的敏感性和特异性比较分析以及可靠性和有效性测试。

目的：评估计算机辅助认知测试（CACT）的信度和效度：方法：选取同济医院脑健康队列中的219例受试者（115例轻度认知功能障碍（MCI）患者和104例正常对照组），其中24例在2周后接受复测。结果：（1）信度：（a）量表总分的内部一致性信度为 0.645；（b）量表总分的重测信度相关系数为 0.900；(c) Guttman 分半系数为 0.631；(2) 效度：(a) 建构效度分析表明，各部分得分之间的相关系数介于 0.036 和 0.408 之间，各部分得分与总分之间的相关系数介于 0.468 和 0.781 之间；（b）标准效度分析表明，CACT 总分与迷你精神状态检查（MMSE）总分的相关系数为 0.733，CACT 总分与蒙特利尔认知评估（MoCA）基本版总分的相关系数为 0.763；（c）CACT 区分 MCI 患者和对照组的 ROC 曲线下面积为 0.920，最佳诊断阈值为 20，灵敏度为 88.5%，特异度为 80.9%：结论：CACT 受教育水平的影响很小。结论：CACT 受教育程度的影响很小，具有良好的可靠性和有效性，可用于认知功能障碍的早期临床筛查。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Applied Neuropsychology-Adult CLINICAL NEUROLOGY-PSYCHOLOGY

自引率

11.80%

发文量

审稿时长

>12 weeks