Rosanne L van den Berg, Sophie M van der Landen, Matthijs J Keijzer, Aniek M van Gils, Maureen van Dam, Kirsten A Ziesemer, Roos J Jutten, John E Harrison, Casper de Boer, Wiesje M van der Flier, Sietske Am Sikkes
{"title":"基于智能手机和平板电脑的工具评估临床前阿尔茨海默病和轻度认知障碍患者的认知:范围审查","authors":"Rosanne L van den Berg, Sophie M van der Landen, Matthijs J Keijzer, Aniek M van Gils, Maureen van Dam, Kirsten A Ziesemer, Roos J Jutten, John E Harrison, Casper de Boer, Wiesje M van der Flier, Sietske Am Sikkes","doi":"10.2196/65297","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Assessment of cognitive decline in the earliest stages of Alzheimer disease (AD) is important but challenging. AD is a neurodegenerative disease characterized by gradual cognitive decline. Disease stages range from preclinical AD, in which individuals are cognitively unimpaired, to mild cognitive impairment (MCI) and dementia. Digital technologies promise to enable detection of early, subtle cognitive changes. Although the field of digital cognitive biomarkers is rapidly evolving, a comprehensive overview of the reporting of psychometric properties (ie, validity, reliability, responsiveness, and clinical meaningfulness) is missing. Insight into the extent to which these properties are evaluated is needed to identify the validation steps toward implementation.</p><p><strong>Objective: </strong>This scoping review aimed to identify the reporting on quality characteristics of smartphone- and tablet-based cognitive tools with potential for remote administration in individuals with preclinical AD or MCI. We focused on both psychometric properties and practical tool characteristics.</p><p><strong>Methods: </strong>This scoping review was conducted following the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines. In total, 4 databases (PubMed, Embase, Web of Science, and PsycINFO) were systematically searched from January 1, 2008, to January 5, 2023. Studies were included that assessed the psychometric properties of cognitive smartphone- or tablet-based tools with potential for remote administration in individuals with preclinical AD or MCI. In total, 2 reviewers independently screened titles and abstracts in ASReview, a screening tool that combines manual and automatic screening using an active learning algorithm. Thereafter, we manually screened full texts in the web application Rayyan. For each included study, 2 reviewers independently explored the reported information on practical and psychometric properties. For each psychometric property, examples were provided narratively.</p><p><strong>Results: </strong>In total, 11,300 deduplicated studies were identified in the search. After screening, 50 studies describing 37 different digital tools were included in this review. Average administration time was 13.8 (SD 10.1; range 1-32) minutes, but for 38% (14/37) of the tools, this was not described. Most tools (31/37, 84%) were examined in 1 language. The investigated populations were mainly individuals with MCI (34/37, 92%), and fewer tools were examined in individuals with preclinical AD (8/37, 22%). For almost all tools (36/37, 97%), construct validity was assessed through evaluation of clinical or biological associations or relevant group differences. For a small number of tools, information on structural validity (3/37, 8%), test-retest reliability (12/37, 32%), responsiveness (6/37, 16%), or clinical meaningfulness (0%) was reported.</p><p><strong>Conclusions: </strong>Numerous smartphone- and tablet-based tools to assess cognition in early AD are being developed, whereas studies concerning their psychometric properties are limited. Often, initial validation steps have been taken, yet further validation and careful selection of psychometrically valid outcome scores are required to demonstrate clinical usefulness with regard to the context of use, which is essential for implementation.</p>","PeriodicalId":16337,"journal":{"name":"Journal of Medical Internet Research","volume":"27 ","pages":"e65297"},"PeriodicalIF":5.8000,"publicationDate":"2025-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Smartphone- and Tablet-Based Tools to Assess Cognition in Individuals With Preclinical Alzheimer Disease and Mild Cognitive Impairment: Scoping Review.\",\"authors\":\"Rosanne L van den Berg, Sophie M van der Landen, Matthijs J Keijzer, Aniek M van Gils, Maureen van Dam, Kirsten A Ziesemer, Roos J Jutten, John E Harrison, Casper de Boer, Wiesje M van der Flier, Sietske Am Sikkes\",\"doi\":\"10.2196/65297\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Assessment of cognitive decline in the earliest stages of Alzheimer disease (AD) is important but challenging. AD is a neurodegenerative disease characterized by gradual cognitive decline. Disease stages range from preclinical AD, in which individuals are cognitively unimpaired, to mild cognitive impairment (MCI) and dementia. Digital technologies promise to enable detection of early, subtle cognitive changes. Although the field of digital cognitive biomarkers is rapidly evolving, a comprehensive overview of the reporting of psychometric properties (ie, validity, reliability, responsiveness, and clinical meaningfulness) is missing. Insight into the extent to which these properties are evaluated is needed to identify the validation steps toward implementation.</p><p><strong>Objective: </strong>This scoping review aimed to identify the reporting on quality characteristics of smartphone- and tablet-based cognitive tools with potential for remote administration in individuals with preclinical AD or MCI. We focused on both psychometric properties and practical tool characteristics.</p><p><strong>Methods: </strong>This scoping review was conducted following the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines. In total, 4 databases (PubMed, Embase, Web of Science, and PsycINFO) were systematically searched from January 1, 2008, to January 5, 2023. Studies were included that assessed the psychometric properties of cognitive smartphone- or tablet-based tools with potential for remote administration in individuals with preclinical AD or MCI. In total, 2 reviewers independently screened titles and abstracts in ASReview, a screening tool that combines manual and automatic screening using an active learning algorithm. Thereafter, we manually screened full texts in the web application Rayyan. For each included study, 2 reviewers independently explored the reported information on practical and psychometric properties. For each psychometric property, examples were provided narratively.</p><p><strong>Results: </strong>In total, 11,300 deduplicated studies were identified in the search. After screening, 50 studies describing 37 different digital tools were included in this review. Average administration time was 13.8 (SD 10.1; range 1-32) minutes, but for 38% (14/37) of the tools, this was not described. Most tools (31/37, 84%) were examined in 1 language. The investigated populations were mainly individuals with MCI (34/37, 92%), and fewer tools were examined in individuals with preclinical AD (8/37, 22%). For almost all tools (36/37, 97%), construct validity was assessed through evaluation of clinical or biological associations or relevant group differences. For a small number of tools, information on structural validity (3/37, 8%), test-retest reliability (12/37, 32%), responsiveness (6/37, 16%), or clinical meaningfulness (0%) was reported.</p><p><strong>Conclusions: </strong>Numerous smartphone- and tablet-based tools to assess cognition in early AD are being developed, whereas studies concerning their psychometric properties are limited. Often, initial validation steps have been taken, yet further validation and careful selection of psychometrically valid outcome scores are required to demonstrate clinical usefulness with regard to the context of use, which is essential for implementation.</p>\",\"PeriodicalId\":16337,\"journal\":{\"name\":\"Journal of Medical Internet Research\",\"volume\":\"27 \",\"pages\":\"e65297\"},\"PeriodicalIF\":5.8000,\"publicationDate\":\"2025-05-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Medical Internet Research\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.2196/65297\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"HEALTH CARE SCIENCES & SERVICES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Medical Internet Research","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.2196/65297","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
摘要
背景:评估阿尔茨海默病(AD)早期阶段的认知能力下降是重要但具有挑战性的。AD是一种以认知能力逐渐下降为特征的神经退行性疾病。疾病阶段包括临床前AD(个体认知未受损)到轻度认知障碍(MCI)和痴呆。数字技术有望及早发现细微的认知变化。尽管数字认知生物标志物领域正在迅速发展,但对心理测量特性(即效度、信度、反应性和临床意义)报告的全面概述仍然缺失。需要深入了解这些属性的评估程度,以确定实现的验证步骤。目的:本综述旨在确定基于智能手机和平板电脑的认知工具的质量特征,这些工具在临床前AD或MCI患者中具有远程给药的潜力。我们关注的是心理测量特性和实用工具的特性。方法:本范围评价遵循PRISMA-ScR(范围评价的系统评价和元分析扩展首选报告项目)指南进行。从2008年1月1日到2023年1月5日,共系统检索了4个数据库(PubMed、Embase、Web of Science和PsycINFO)。研究包括评估基于智能手机或平板电脑的认知工具的心理测量特性,这些工具在临床前AD或MCI患者中具有远程给药的潜力。总共有2名审稿人在ASReview中独立筛选标题和摘要,ASReview是一个使用主动学习算法结合手动和自动筛选的筛选工具。此后,我们在web应用Rayyan中手动筛选全文。对于每项纳入的研究,2名审稿人独立地探讨了报告的实用和心理测量特性信息。对于每个心理测量属性,都提供了叙述性的例子。结果:在检索中总共确定了11,300个重复研究。经过筛选,本综述纳入了50项研究,描述了37种不同的数字工具。平均给药时间13.8天(SD 10.1;范围1-32)分钟,但对于38%(14/37)的工具,没有描述这一点。大多数工具(31/37,84%)只用一种语言进行检查。调查人群主要是MCI个体(34/ 37,92%),较少的工具用于临床前AD个体(8/ 37,22%)。对于几乎所有工具(36/ 37,97%),通过评估临床或生物学关联或相关组差异来评估结构效度。对于少数工具,报告了结构效度(3/ 37,8%)、重测信度(12/ 37,32%)、反应性(6/ 37,16%)或临床意义(0%)的信息。结论:目前正在开发许多基于智能手机和平板电脑的工具来评估早期AD患者的认知能力,而有关其心理测量特性的研究却很有限。通常,已经采取了初始验证步骤,但需要进一步验证和仔细选择心理测量学上有效的结果分数,以证明关于使用背景的临床有用性,这对于实施是必不可少的。
Smartphone- and Tablet-Based Tools to Assess Cognition in Individuals With Preclinical Alzheimer Disease and Mild Cognitive Impairment: Scoping Review.
Background: Assessment of cognitive decline in the earliest stages of Alzheimer disease (AD) is important but challenging. AD is a neurodegenerative disease characterized by gradual cognitive decline. Disease stages range from preclinical AD, in which individuals are cognitively unimpaired, to mild cognitive impairment (MCI) and dementia. Digital technologies promise to enable detection of early, subtle cognitive changes. Although the field of digital cognitive biomarkers is rapidly evolving, a comprehensive overview of the reporting of psychometric properties (ie, validity, reliability, responsiveness, and clinical meaningfulness) is missing. Insight into the extent to which these properties are evaluated is needed to identify the validation steps toward implementation.
Objective: This scoping review aimed to identify the reporting on quality characteristics of smartphone- and tablet-based cognitive tools with potential for remote administration in individuals with preclinical AD or MCI. We focused on both psychometric properties and practical tool characteristics.
Methods: This scoping review was conducted following the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines. In total, 4 databases (PubMed, Embase, Web of Science, and PsycINFO) were systematically searched from January 1, 2008, to January 5, 2023. Studies were included that assessed the psychometric properties of cognitive smartphone- or tablet-based tools with potential for remote administration in individuals with preclinical AD or MCI. In total, 2 reviewers independently screened titles and abstracts in ASReview, a screening tool that combines manual and automatic screening using an active learning algorithm. Thereafter, we manually screened full texts in the web application Rayyan. For each included study, 2 reviewers independently explored the reported information on practical and psychometric properties. For each psychometric property, examples were provided narratively.
Results: In total, 11,300 deduplicated studies were identified in the search. After screening, 50 studies describing 37 different digital tools were included in this review. Average administration time was 13.8 (SD 10.1; range 1-32) minutes, but for 38% (14/37) of the tools, this was not described. Most tools (31/37, 84%) were examined in 1 language. The investigated populations were mainly individuals with MCI (34/37, 92%), and fewer tools were examined in individuals with preclinical AD (8/37, 22%). For almost all tools (36/37, 97%), construct validity was assessed through evaluation of clinical or biological associations or relevant group differences. For a small number of tools, information on structural validity (3/37, 8%), test-retest reliability (12/37, 32%), responsiveness (6/37, 16%), or clinical meaningfulness (0%) was reported.
Conclusions: Numerous smartphone- and tablet-based tools to assess cognition in early AD are being developed, whereas studies concerning their psychometric properties are limited. Often, initial validation steps have been taken, yet further validation and careful selection of psychometrically valid outcome scores are required to demonstrate clinical usefulness with regard to the context of use, which is essential for implementation.
期刊介绍:
The Journal of Medical Internet Research (JMIR) is a highly respected publication in the field of health informatics and health services. With a founding date in 1999, JMIR has been a pioneer in the field for over two decades.
As a leader in the industry, the journal focuses on digital health, data science, health informatics, and emerging technologies for health, medicine, and biomedical research. It is recognized as a top publication in these disciplines, ranking in the first quartile (Q1) by Impact Factor.
Notably, JMIR holds the prestigious position of being ranked #1 on Google Scholar within the "Medical Informatics" discipline.