Marirena Bafaloukou, Ann-Kathrin Schalkamp, Nan Fletcher-Lloyd, Alex Capstick, Chloe Walsh, Cynthia Sandor, Samaneh Kouchaki, Ramin Nilforooshan, Payam Barnaghi
{"title":"一种可解释的机器学习工具,用于家庭监测痴呆症患者的躁动发作:一项概念验证研究。","authors":"Marirena Bafaloukou, Ann-Kathrin Schalkamp, Nan Fletcher-Lloyd, Alex Capstick, Chloe Walsh, Cynthia Sandor, Samaneh Kouchaki, Ramin Nilforooshan, Payam Barnaghi","doi":"10.1016/j.eclinm.2024.103032","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Agitation affects around 30% of people living with dementia (PLwD), increasing carer burden and straining care services. Agitation identification typically relies on subjective clinical scales and direct patient observation, which are resource-intensive and challenging to incorporate into routine care. Clinical applicability of data-driven methods for agitation monitoring is limited by constraints such as short observational periods, data granularity, and lack of interpretability and generalisation. Current interventions for agitation are primarily medication-based, which may lead to severe side effects and lack personalisation. Understanding how real-world factors interact with agitation within home settings offers a promising avenue towards identifying potential personalised non-pharmacological interventions.</p><p><strong>Methods: </strong>We used longitudinal data (32,896 person-days from n = 63 PLwD) collected using in-home monitoring devices between December 2020 and March 2023. Employing machine learning techniques, we developed a monitoring tool to identify the presence of agitation during the week. We incorporated a traffic-light system to stratify agitation probability estimates supporting clinical decision-making, and employed the SHapley Additive exPlanations (SHAP) framework to enhance interpretability. We designed an interactive tool that enables the exploration of personalised non-pharmacological interventions, such as modifying ambient light and temperature.</p><p><strong>Findings: </strong>Light Gradient-boosting Machine (LightGBM) achieved the highest performance in identifying agitation over an 8-day period with a sensitivity of 71.32% ± 7.38 and specificity of 75.28% ± 7.38. Implementing the traffic-light system for stratification increased specificity to 90.3% ± 7.55 and improved all metrics. Key features for identifying agitation included low nocturnal respiratory rate, heightened alertness during sleep, and increased indoor illuminance, as revealed by statistical and feature importance analysis. Using our interactive tool, we identified indoor lighting and temperature adjustments as the most promising and feasible intervention options within our cohort.</p><p><strong>Interpretation: </strong>Our interpretable framework for agitation monitoring, developed using data from a dementia care study, showcases significant clinical value. The accompanying interactive interface allows for the <i>in-silico</i> simulation of non-pharmacological interventions, facilitating the design of personalised interventions that can improve in-home dementia care.</p><p><strong>Funding: </strong>This study is funded by the UK Dementia Research Institute [award number UK DRI-7002] through UK DRI Ltd, principally funded by the Medical Research Council (MRC), and the UKRI Engineering and Physical Sciences Research Council (EPSRC) PROTECT Project (grant number: EP/W031892/1). Infrastructure support for this research was provided by the NIHR Imperial Biomedical Research Centre (BRC) and the UKRI Medical Research Council (MRC). P.B. is also funded by the Great Ormond Street Hospital and the Royal Academy of Engineering. C.S. is supported by the UK Dementia Research Institute [award number UK DRI-5209], a UKRI Future Leaders Fellowship [MR/MR/X032892/1] and the Edmond J. Safra Foundation. R.N. is funded by UK Dementia Research Institute [award number UK DRI-7002] and the UKRI Engineering and Physical Sciences Research Council (EPSRC) PROTECT Project (grant number: EP/W031892/1). M.B. and A.K.S. are funded by the UK Dementia Research Institute [award number UKDRI-7002 and UKDRI-5209]. N.F.L., A.C., C.W. and S.K. are funded by the UK Dementia Research Institute [award number UK DRI-7002].</p>","PeriodicalId":11393,"journal":{"name":"EClinicalMedicine","volume":"80 ","pages":"103032"},"PeriodicalIF":9.6000,"publicationDate":"2025-01-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11787694/pdf/","citationCount":"0","resultStr":"{\"title\":\"An interpretable machine learning tool for in-home monitoring of agitation episodes in people living with dementia: a proof-of-concept study.\",\"authors\":\"Marirena Bafaloukou, Ann-Kathrin Schalkamp, Nan Fletcher-Lloyd, Alex Capstick, Chloe Walsh, Cynthia Sandor, Samaneh Kouchaki, Ramin Nilforooshan, Payam Barnaghi\",\"doi\":\"10.1016/j.eclinm.2024.103032\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Agitation affects around 30% of people living with dementia (PLwD), increasing carer burden and straining care services. Agitation identification typically relies on subjective clinical scales and direct patient observation, which are resource-intensive and challenging to incorporate into routine care. Clinical applicability of data-driven methods for agitation monitoring is limited by constraints such as short observational periods, data granularity, and lack of interpretability and generalisation. Current interventions for agitation are primarily medication-based, which may lead to severe side effects and lack personalisation. Understanding how real-world factors interact with agitation within home settings offers a promising avenue towards identifying potential personalised non-pharmacological interventions.</p><p><strong>Methods: </strong>We used longitudinal data (32,896 person-days from n = 63 PLwD) collected using in-home monitoring devices between December 2020 and March 2023. Employing machine learning techniques, we developed a monitoring tool to identify the presence of agitation during the week. We incorporated a traffic-light system to stratify agitation probability estimates supporting clinical decision-making, and employed the SHapley Additive exPlanations (SHAP) framework to enhance interpretability. We designed an interactive tool that enables the exploration of personalised non-pharmacological interventions, such as modifying ambient light and temperature.</p><p><strong>Findings: </strong>Light Gradient-boosting Machine (LightGBM) achieved the highest performance in identifying agitation over an 8-day period with a sensitivity of 71.32% ± 7.38 and specificity of 75.28% ± 7.38. Implementing the traffic-light system for stratification increased specificity to 90.3% ± 7.55 and improved all metrics. Key features for identifying agitation included low nocturnal respiratory rate, heightened alertness during sleep, and increased indoor illuminance, as revealed by statistical and feature importance analysis. Using our interactive tool, we identified indoor lighting and temperature adjustments as the most promising and feasible intervention options within our cohort.</p><p><strong>Interpretation: </strong>Our interpretable framework for agitation monitoring, developed using data from a dementia care study, showcases significant clinical value. The accompanying interactive interface allows for the <i>in-silico</i> simulation of non-pharmacological interventions, facilitating the design of personalised interventions that can improve in-home dementia care.</p><p><strong>Funding: </strong>This study is funded by the UK Dementia Research Institute [award number UK DRI-7002] through UK DRI Ltd, principally funded by the Medical Research Council (MRC), and the UKRI Engineering and Physical Sciences Research Council (EPSRC) PROTECT Project (grant number: EP/W031892/1). Infrastructure support for this research was provided by the NIHR Imperial Biomedical Research Centre (BRC) and the UKRI Medical Research Council (MRC). P.B. is also funded by the Great Ormond Street Hospital and the Royal Academy of Engineering. C.S. is supported by the UK Dementia Research Institute [award number UK DRI-5209], a UKRI Future Leaders Fellowship [MR/MR/X032892/1] and the Edmond J. Safra Foundation. R.N. is funded by UK Dementia Research Institute [award number UK DRI-7002] and the UKRI Engineering and Physical Sciences Research Council (EPSRC) PROTECT Project (grant number: EP/W031892/1). M.B. and A.K.S. are funded by the UK Dementia Research Institute [award number UKDRI-7002 and UKDRI-5209]. N.F.L., A.C., C.W. and S.K. are funded by the UK Dementia Research Institute [award number UK DRI-7002].</p>\",\"PeriodicalId\":11393,\"journal\":{\"name\":\"EClinicalMedicine\",\"volume\":\"80 \",\"pages\":\"103032\"},\"PeriodicalIF\":9.6000,\"publicationDate\":\"2025-01-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11787694/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"EClinicalMedicine\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1016/j.eclinm.2024.103032\",\"RegionNum\":1,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/2/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"Q1\",\"JCRName\":\"MEDICINE, GENERAL & INTERNAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"EClinicalMedicine","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.eclinm.2024.103032","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/2/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}
引用次数: 0
摘要
背景:躁动影响了大约30%的痴呆症患者,增加了护理人员的负担并使护理服务紧张。躁动识别通常依赖于主观临床量表和直接患者观察,这是资源密集型的,难以纳入日常护理。数据驱动的躁动监测方法的临床适用性受到诸如观测周期短、数据粒度、缺乏可解释性和泛化等约束的限制。目前对躁动的干预主要是基于药物的,这可能导致严重的副作用和缺乏个性化。了解现实世界因素如何与家庭环境中的躁动相互作用,为确定潜在的个性化非药物干预措施提供了一条有希望的途径。方法:我们使用了2020年12月至2023年3月期间使用家庭监测设备收集的纵向数据(来自n = 63个PLwD的32,896人日)。利用机器学习技术,我们开发了一种监测工具来识别一周内躁动的存在。我们采用红绿灯系统对支持临床决策的躁动概率估计进行分层,并采用SHapley加性解释(SHAP)框架来提高可解释性。我们设计了一个交互式工具,可以探索个性化的非药物干预措施,如改变环境光和温度。结果:光梯度增强机(Light Gradient-boosting Machine, LightGBM)在识别8天内的烦躁情绪方面表现最佳,灵敏度为71.32%±7.38,特异性为75.28%±7.38。实施红绿灯系统分层将特异性提高到90.3%±7.55,并改善了所有指标。统计和特征重要性分析显示,识别躁动的关键特征包括夜间呼吸频率低、睡眠时警觉性提高和室内照度增加。使用我们的互动工具,我们确定室内照明和温度调节是我们队列中最有希望和可行的干预选择。解释:我们使用痴呆护理研究数据开发的躁动监测可解释框架显示了显著的临床价值。附带的交互界面允许非药物干预的计算机模拟,促进个性化干预的设计,可以改善家庭痴呆症护理。资金:本研究由英国痴呆症研究所[奖励号UK DRI-7002]通过UK DRI有限公司资助,主要由医学研究理事会(MRC)和UKRI工程与物理科学研究理事会(EPSRC) PROTECT项目(资助号:EP/W031892/1)资助。这项研究的基础设施支持由NIHR帝国生物医学研究中心(BRC)和UKRI医学研究委员会(MRC)提供。P.B.也由大奥蒙德街医院和皇家工程院资助。C.S.得到了英国痴呆症研究所[奖励号UK dr -5209], UKRI未来领袖奖学金[MR/MR/X032892/1]和Edmond J. Safra基金会的支持。R.N.由英国痴呆症研究所[资助号:UK dr -7002]和英国痴呆症研究所工程与物理科学研究委员会(EPSRC) PROTECT项目(资助号:EP/W031892/1)资助。m.b.a.和A.K.S.由英国痴呆症研究所资助[奖励号UKDRI-7002和UKDRI-5209]。N.F.L, a.c., C.W.和S.K.由英国痴呆症研究所资助[资助号UK dr -7002]。
An interpretable machine learning tool for in-home monitoring of agitation episodes in people living with dementia: a proof-of-concept study.
Background: Agitation affects around 30% of people living with dementia (PLwD), increasing carer burden and straining care services. Agitation identification typically relies on subjective clinical scales and direct patient observation, which are resource-intensive and challenging to incorporate into routine care. Clinical applicability of data-driven methods for agitation monitoring is limited by constraints such as short observational periods, data granularity, and lack of interpretability and generalisation. Current interventions for agitation are primarily medication-based, which may lead to severe side effects and lack personalisation. Understanding how real-world factors interact with agitation within home settings offers a promising avenue towards identifying potential personalised non-pharmacological interventions.
Methods: We used longitudinal data (32,896 person-days from n = 63 PLwD) collected using in-home monitoring devices between December 2020 and March 2023. Employing machine learning techniques, we developed a monitoring tool to identify the presence of agitation during the week. We incorporated a traffic-light system to stratify agitation probability estimates supporting clinical decision-making, and employed the SHapley Additive exPlanations (SHAP) framework to enhance interpretability. We designed an interactive tool that enables the exploration of personalised non-pharmacological interventions, such as modifying ambient light and temperature.
Findings: Light Gradient-boosting Machine (LightGBM) achieved the highest performance in identifying agitation over an 8-day period with a sensitivity of 71.32% ± 7.38 and specificity of 75.28% ± 7.38. Implementing the traffic-light system for stratification increased specificity to 90.3% ± 7.55 and improved all metrics. Key features for identifying agitation included low nocturnal respiratory rate, heightened alertness during sleep, and increased indoor illuminance, as revealed by statistical and feature importance analysis. Using our interactive tool, we identified indoor lighting and temperature adjustments as the most promising and feasible intervention options within our cohort.
Interpretation: Our interpretable framework for agitation monitoring, developed using data from a dementia care study, showcases significant clinical value. The accompanying interactive interface allows for the in-silico simulation of non-pharmacological interventions, facilitating the design of personalised interventions that can improve in-home dementia care.
Funding: This study is funded by the UK Dementia Research Institute [award number UK DRI-7002] through UK DRI Ltd, principally funded by the Medical Research Council (MRC), and the UKRI Engineering and Physical Sciences Research Council (EPSRC) PROTECT Project (grant number: EP/W031892/1). Infrastructure support for this research was provided by the NIHR Imperial Biomedical Research Centre (BRC) and the UKRI Medical Research Council (MRC). P.B. is also funded by the Great Ormond Street Hospital and the Royal Academy of Engineering. C.S. is supported by the UK Dementia Research Institute [award number UK DRI-5209], a UKRI Future Leaders Fellowship [MR/MR/X032892/1] and the Edmond J. Safra Foundation. R.N. is funded by UK Dementia Research Institute [award number UK DRI-7002] and the UKRI Engineering and Physical Sciences Research Council (EPSRC) PROTECT Project (grant number: EP/W031892/1). M.B. and A.K.S. are funded by the UK Dementia Research Institute [award number UKDRI-7002 and UKDRI-5209]. N.F.L., A.C., C.W. and S.K. are funded by the UK Dementia Research Institute [award number UK DRI-7002].
期刊介绍:
eClinicalMedicine is a gold open-access clinical journal designed to support frontline health professionals in addressing the complex and rapid health transitions affecting societies globally. The journal aims to assist practitioners in overcoming healthcare challenges across diverse communities, spanning diagnosis, treatment, prevention, and health promotion. Integrating disciplines from various specialties and life stages, it seeks to enhance health systems as fundamental institutions within societies. With a forward-thinking approach, eClinicalMedicine aims to redefine the future of healthcare.