Handwriting in Mild Cognitive Impairment: Reliability Assessment and Machine Learning-Based Screening.

IF 4.8 Q1 GERIATRICS & GERONTOLOGY
JMIR Aging Pub Date : 2025-09-23 DOI:10.2196/73074
Simone Toffoli, Carlo Abbate, Francesca Lunardini, Edoardo Corno, Nicholas Diani, Alessia Gallucci, Emanuele Tomasini, Pietro Davide Trimarchi, Simona Ferrante
{"title":"Handwriting in Mild Cognitive Impairment: Reliability Assessment and Machine Learning-Based Screening.","authors":"Simone Toffoli, Carlo Abbate, Francesca Lunardini, Edoardo Corno, Nicholas Diani, Alessia Gallucci, Emanuele Tomasini, Pietro Davide Trimarchi, Simona Ferrante","doi":"10.2196/73074","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Mild cognitive impairment (MCI) is a precursor of dementia. Therefore, MCI identification and monitoring are crucial to delaying dementia onset. Given the limits of existing clinical tests, objective support tools are needed.</p><p><strong>Objective: </strong>This work investigates quantitative handwriting analysis, tailored to enable domestic monitoring, as a noninvasive approach for MCI screening and assessment.</p><p><strong>Methods: </strong>A sensorized ink pen, used on paper and equipped with sensors, memory, and a communication unit, was used for data acquisition. The tasks included writing a grocery list and free text to mimic daily life handwriting, and a clinical dictation test (parole-non-parole [PnP] test), featuring regular, irregular, and made-up words, aimed at assessing MCI dysgraphia. From the recorded data, 106 indicators describing the performance in terms of time, fluency, exerted force, and pen inclination were computed. A total of 57 patients with MCI were recruited, of whom 45 performed a test-retest protocol. The indicators were examined to assess their test-retest reliability. The indicators from the test repetition were used to assess their relationship with the scores of clinical tests via correlation analysis. For the PnP test, differences in the indicators among the 3 types of words were statistically investigated. These analyses were conducted separately for the cursive (2/3 of the sample) and block letters (1/3 of the sample) allographs, with the level of significance set at 5%. Data from healthy older adults were available for the grocery list (34 participants) and free text (45 participants) tasks. These were exploited to build machine learning classification models for the distinction between patients with MCI and healthy controls.</p><p><strong>Results: </strong>When dealing with reliability, 93% and 44% of the indicators were characterized by a significant reliability of at least moderate intensity for cursive and block letters respectively. As for the correlation analysis, patients with preserved cognitive status and daily life functionality were associated with significantly better temporal performances, both in free writing and PnP. The analysis of PnP highlighted the presence of surface dysgraphia in the recruited sample, as irregular words showed significantly worse temporal indicators with respect to regular and made-up ones. The classification models' built-in free writing data achieved accuracies ranging from 0.80 to 0.93 and F<sub>1</sub>-scores from 0.81 to 0.92 according to the input dataset.</p><p><strong>Conclusions: </strong>The presented results suggest the suitability of ecological handwriting analysis for the all-around monitoring of MCI, from early screening to disease progression evaluation.</p>","PeriodicalId":36245,"journal":{"name":"JMIR Aging","volume":"8 ","pages":"e73074"},"PeriodicalIF":4.8000,"publicationDate":"2025-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR Aging","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2196/73074","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GERIATRICS & GERONTOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Background: Mild cognitive impairment (MCI) is a precursor of dementia. Therefore, MCI identification and monitoring are crucial to delaying dementia onset. Given the limits of existing clinical tests, objective support tools are needed.

Objective: This work investigates quantitative handwriting analysis, tailored to enable domestic monitoring, as a noninvasive approach for MCI screening and assessment.

Methods: A sensorized ink pen, used on paper and equipped with sensors, memory, and a communication unit, was used for data acquisition. The tasks included writing a grocery list and free text to mimic daily life handwriting, and a clinical dictation test (parole-non-parole [PnP] test), featuring regular, irregular, and made-up words, aimed at assessing MCI dysgraphia. From the recorded data, 106 indicators describing the performance in terms of time, fluency, exerted force, and pen inclination were computed. A total of 57 patients with MCI were recruited, of whom 45 performed a test-retest protocol. The indicators were examined to assess their test-retest reliability. The indicators from the test repetition were used to assess their relationship with the scores of clinical tests via correlation analysis. For the PnP test, differences in the indicators among the 3 types of words were statistically investigated. These analyses were conducted separately for the cursive (2/3 of the sample) and block letters (1/3 of the sample) allographs, with the level of significance set at 5%. Data from healthy older adults were available for the grocery list (34 participants) and free text (45 participants) tasks. These were exploited to build machine learning classification models for the distinction between patients with MCI and healthy controls.

Results: When dealing with reliability, 93% and 44% of the indicators were characterized by a significant reliability of at least moderate intensity for cursive and block letters respectively. As for the correlation analysis, patients with preserved cognitive status and daily life functionality were associated with significantly better temporal performances, both in free writing and PnP. The analysis of PnP highlighted the presence of surface dysgraphia in the recruited sample, as irregular words showed significantly worse temporal indicators with respect to regular and made-up ones. The classification models' built-in free writing data achieved accuracies ranging from 0.80 to 0.93 and F1-scores from 0.81 to 0.92 according to the input dataset.

Conclusions: The presented results suggest the suitability of ecological handwriting analysis for the all-around monitoring of MCI, from early screening to disease progression evaluation.

轻度认知障碍的手写:可靠性评估和基于机器学习的筛选。
背景:轻度认知障碍(MCI)是痴呆的前兆。因此,MCI的识别和监测对于延缓痴呆的发病至关重要。鉴于现有临床试验的局限性,需要客观的支持工具。目的:本研究探讨了定量笔迹分析,使国内监测,作为MCI筛查和评估的无创方法。方法:采用传感墨水笔,在纸上使用,配备传感器、存储器和通信单元,用于数据采集。任务包括写一份购物清单和免费文本来模仿日常生活中的笔迹,以及一个临床听写测试(假释-非假释[PnP]测试),包括规则的、不规则的和虚构的单词,旨在评估MCI书写困难症。从记录的数据中,计算了106个指标,包括时间、流畅性、施加的力和笔的倾斜度。共招募了57名轻度认知损伤患者,其中45人进行了重新测试。对指标进行检验以评估其重测信度。通过相关分析,评价试验重复指标与临床试验得分的关系。在PnP检验中,对3类词汇的指标差异进行统计分析。这些分析分别对草书(样本的2/3)和正体字母(样本的1/3)异体文字进行,显著性水平设置为5%。来自健康老年人的数据可用于购物清单(34名参与者)和免费文本(45名参与者)任务。这些数据被用来建立机器学习分类模型,以区分轻度认知障碍患者和健康对照组。结果:在信度处理方面,93%和44%的指标分别对草书和正体字母具有至少中等强度的显著信度。在相关性分析方面,保留认知状态和日常生活功能的患者在自由写作和PnP方面的时间表现均显著较好。PnP分析强调了招募样本中存在的表面书写障碍,因为不规则单词的时间指标明显比规则单词和合成单词差。根据输入数据集,分类模型内置的自由写入数据的准确率在0.80 ~ 0.93之间,f1得分在0.81 ~ 0.92之间。结论:本研究结果表明,生态笔迹分析适合于MCI的全面监测,从早期筛查到疾病进展评估。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
JMIR Aging
JMIR Aging Social Sciences-Health (social science)
CiteScore
6.50
自引率
4.10%
发文量
71
审稿时长
12 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信