Co Yih Siow, Yao-Hua Yang, Cheng-Jui Tsai, Wan-Wan Yang, Chaur-Jong Hu, Jia-Ying Sung, Jowy Tani
{"title":"基于视觉人工智能的游戏化认知假体:可行性与可用性研究。","authors":"Co Yih Siow, Yao-Hua Yang, Cheng-Jui Tsai, Wan-Wan Yang, Chaur-Jong Hu, Jia-Ying Sung, Jowy Tani","doi":"10.2196/74157","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Dementia is a progressive neurodegenerative condition marked by cognitive decline and loss of functional independence. Among cognitive domains, executive dysfunction is a critical early contributor to reduced self-care capacity and increased caregiver burden. While cognitive assistive technologies have focused primarily on memory, few tools address executive function in real-time, daily tasks. To fill this gap, we developed a novel gamified cognitive prosthesis that integrates artificial intelligence (AI) and computer vision to guide users step-by-step through a simulated egg-cooking task. This system provides real-time audiovisual feedback to support planning, sequencing, and error correction.</p><p><strong>Objective: </strong>This study aimed to evaluate whether the AI-based cognitive prosthesis improves task completion time and executive function performance in individuals with mild dementia.</p><p><strong>Methods: </strong>We conducted a pilot study involving 12 patients with mild dementia and 7 age-matched healthy controls. Participants were asked to complete a 6-step gamified egg boiling task under 2 conditions: with and without guidance. The task was evaluated using a custom \"Daily Task Completion Test\" and a modified executive function performance test (EFPT) adapted to the cooking activity. Demographic and clinical data (age, sex, education, Mini-Mental State Examination, Clinical Dementia Rating, activities of daily living, instrumental activities of daily living, and Dementia Severity Rating Scale) were recorded. The System Usability Scale (SUS) was also collected postintervention.</p><p><strong>Results: </strong>In the mild dementia group, AI assistance significantly reduced median task completion time from 134.75 (IQR 92.50-134.75) to 92.00 (IQR 65.00-92.00; P=.03) seconds, and significantly improved the Executive Function Performance Test (EFPT) scores from 4.25 (IQR 1.75-4.25) to 1.00 (IQR 0.00-1.00; P=.005), reflecting a 31.7% improvement in efficiency and a 76.5% reduction in required assistance. No significant changes were observed in the control group. The mean SUS score was 80.53 (SD 24.97), indicating high usability. The AI system achieved a cumulative recognition precision of 0.93 (SD 0.07) and cumulative recall of 0.94 (SD 0.11).</p><p><strong>Conclusions: </strong>This pilot study provides preliminary evidence that an AI-based cognitive prosthesis can enhance executive function and task performance in individuals with mild dementia. The results support the feasibility of using real-time AI guidance in everyday tasks to promote independence. Given its modular design and promising usability profile, this system may serve as the foundation for future digital therapeutics targeting executive dysfunction. Larger, longitudinal studies are warranted to evaluate sustained cognitive and functional benefits.</p>","PeriodicalId":14795,"journal":{"name":"JMIR Serious Games","volume":"13 ","pages":"e74157"},"PeriodicalIF":4.1000,"publicationDate":"2025-10-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12500313/pdf/","citationCount":"0","resultStr":"{\"title\":\"Vision AI-Based Gamified Cognitive Prosthesis for Executive Function: Feasibility and Usability Study.\",\"authors\":\"Co Yih Siow, Yao-Hua Yang, Cheng-Jui Tsai, Wan-Wan Yang, Chaur-Jong Hu, Jia-Ying Sung, Jowy Tani\",\"doi\":\"10.2196/74157\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Dementia is a progressive neurodegenerative condition marked by cognitive decline and loss of functional independence. Among cognitive domains, executive dysfunction is a critical early contributor to reduced self-care capacity and increased caregiver burden. While cognitive assistive technologies have focused primarily on memory, few tools address executive function in real-time, daily tasks. To fill this gap, we developed a novel gamified cognitive prosthesis that integrates artificial intelligence (AI) and computer vision to guide users step-by-step through a simulated egg-cooking task. This system provides real-time audiovisual feedback to support planning, sequencing, and error correction.</p><p><strong>Objective: </strong>This study aimed to evaluate whether the AI-based cognitive prosthesis improves task completion time and executive function performance in individuals with mild dementia.</p><p><strong>Methods: </strong>We conducted a pilot study involving 12 patients with mild dementia and 7 age-matched healthy controls. Participants were asked to complete a 6-step gamified egg boiling task under 2 conditions: with and without guidance. The task was evaluated using a custom \\\"Daily Task Completion Test\\\" and a modified executive function performance test (EFPT) adapted to the cooking activity. Demographic and clinical data (age, sex, education, Mini-Mental State Examination, Clinical Dementia Rating, activities of daily living, instrumental activities of daily living, and Dementia Severity Rating Scale) were recorded. The System Usability Scale (SUS) was also collected postintervention.</p><p><strong>Results: </strong>In the mild dementia group, AI assistance significantly reduced median task completion time from 134.75 (IQR 92.50-134.75) to 92.00 (IQR 65.00-92.00; P=.03) seconds, and significantly improved the Executive Function Performance Test (EFPT) scores from 4.25 (IQR 1.75-4.25) to 1.00 (IQR 0.00-1.00; P=.005), reflecting a 31.7% improvement in efficiency and a 76.5% reduction in required assistance. No significant changes were observed in the control group. The mean SUS score was 80.53 (SD 24.97), indicating high usability. The AI system achieved a cumulative recognition precision of 0.93 (SD 0.07) and cumulative recall of 0.94 (SD 0.11).</p><p><strong>Conclusions: </strong>This pilot study provides preliminary evidence that an AI-based cognitive prosthesis can enhance executive function and task performance in individuals with mild dementia. The results support the feasibility of using real-time AI guidance in everyday tasks to promote independence. Given its modular design and promising usability profile, this system may serve as the foundation for future digital therapeutics targeting executive dysfunction. Larger, longitudinal studies are warranted to evaluate sustained cognitive and functional benefits.</p>\",\"PeriodicalId\":14795,\"journal\":{\"name\":\"JMIR Serious Games\",\"volume\":\"13 \",\"pages\":\"e74157\"},\"PeriodicalIF\":4.1000,\"publicationDate\":\"2025-10-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12500313/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"JMIR Serious Games\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.2196/74157\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"HEALTH CARE SCIENCES & SERVICES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR Serious Games","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.2196/74157","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
Vision AI-Based Gamified Cognitive Prosthesis for Executive Function: Feasibility and Usability Study.
Background: Dementia is a progressive neurodegenerative condition marked by cognitive decline and loss of functional independence. Among cognitive domains, executive dysfunction is a critical early contributor to reduced self-care capacity and increased caregiver burden. While cognitive assistive technologies have focused primarily on memory, few tools address executive function in real-time, daily tasks. To fill this gap, we developed a novel gamified cognitive prosthesis that integrates artificial intelligence (AI) and computer vision to guide users step-by-step through a simulated egg-cooking task. This system provides real-time audiovisual feedback to support planning, sequencing, and error correction.
Objective: This study aimed to evaluate whether the AI-based cognitive prosthesis improves task completion time and executive function performance in individuals with mild dementia.
Methods: We conducted a pilot study involving 12 patients with mild dementia and 7 age-matched healthy controls. Participants were asked to complete a 6-step gamified egg boiling task under 2 conditions: with and without guidance. The task was evaluated using a custom "Daily Task Completion Test" and a modified executive function performance test (EFPT) adapted to the cooking activity. Demographic and clinical data (age, sex, education, Mini-Mental State Examination, Clinical Dementia Rating, activities of daily living, instrumental activities of daily living, and Dementia Severity Rating Scale) were recorded. The System Usability Scale (SUS) was also collected postintervention.
Results: In the mild dementia group, AI assistance significantly reduced median task completion time from 134.75 (IQR 92.50-134.75) to 92.00 (IQR 65.00-92.00; P=.03) seconds, and significantly improved the Executive Function Performance Test (EFPT) scores from 4.25 (IQR 1.75-4.25) to 1.00 (IQR 0.00-1.00; P=.005), reflecting a 31.7% improvement in efficiency and a 76.5% reduction in required assistance. No significant changes were observed in the control group. The mean SUS score was 80.53 (SD 24.97), indicating high usability. The AI system achieved a cumulative recognition precision of 0.93 (SD 0.07) and cumulative recall of 0.94 (SD 0.11).
Conclusions: This pilot study provides preliminary evidence that an AI-based cognitive prosthesis can enhance executive function and task performance in individuals with mild dementia. The results support the feasibility of using real-time AI guidance in everyday tasks to promote independence. Given its modular design and promising usability profile, this system may serve as the foundation for future digital therapeutics targeting executive dysfunction. Larger, longitudinal studies are warranted to evaluate sustained cognitive and functional benefits.
期刊介绍:
JMIR Serious Games (JSG, ISSN 2291-9279) is a sister journal of the Journal of Medical Internet Research (JMIR), one of the most cited journals in health informatics (Impact Factor 2016: 5.175). JSG has a projected impact factor (2016) of 3.32. JSG is a multidisciplinary journal devoted to computer/web/mobile applications that incorporate elements of gaming to solve serious problems such as health education/promotion, teaching and education, or social change.The journal also considers commentary and research in the fields of video games violence and video games addiction.