自动远程睡眠监测需要量化不确定性。

IF 3.4 3区 医学 Q2 CLINICAL NEUROLOGY
Elisabeth R M Heremans, Laura Van den Bulcke, Nabeel Seedat, Astrid Devulder, Pascal Borzée, Bertien Buyse, Dries Testelmans, Maarten Van Den Bossche, Mihaela van der Schaar, Maarten De Vos
{"title":"自动远程睡眠监测需要量化不确定性。","authors":"Elisabeth R M Heremans, Laura Van den Bulcke, Nabeel Seedat, Astrid Devulder, Pascal Borzée, Bertien Buyse, Dries Testelmans, Maarten Van Den Bossche, Mihaela van der Schaar, Maarten De Vos","doi":"10.1111/jsr.14300","DOIUrl":null,"url":null,"abstract":"<p><p>Wearable electroencephalography devices emerge as a cost-effective and ergonomic alternative to gold-standard polysomnography, paving the way for better health monitoring and sleep disorder screening. Machine learning allows to automate sleep stage classification, but trust and reliability issues have hampered its adoption in clinical applications. Estimating uncertainty is a crucial factor in enhancing reliability by identifying regions of heightened and diminished confidence. In this study, we used an uncertainty-centred machine learning pipeline, U-PASS, to automate sleep staging in a challenging real-world dataset of single-channel electroencephalography and accelerometry collected with a wearable device from an elderly population. We were able to effectively limit the uncertainty of our machine learning model and to reliably inform clinical experts of which predictions were uncertain to improve the machine learning model's reliability. This increased the five-stage sleep-scoring accuracy of a state-of-the-art machine learning model from 63.9% to 71.2% on our dataset. Remarkably, the machine learning approach outperformed the human expert in interpreting these wearable data. Manual review by sleep specialists, without specific training for sleep staging on wearable electroencephalography, proved ineffective. The clinical utility of this automated remote monitoring system was also demonstrated, establishing a strong correlation between the predicted sleep parameters and the reference polysomnography parameters, and reproducing known correlations with the apnea-hypopnea index. In essence, this work presents a promising avenue to revolutionize remote patient care through the power of machine learning by the use of an automated data-processing pipeline enhanced with uncertainty estimation.</p>","PeriodicalId":17057,"journal":{"name":"Journal of Sleep Research","volume":null,"pages":null},"PeriodicalIF":3.4000,"publicationDate":"2024-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Automated remote sleep monitoring needs uncertainty quantification.\",\"authors\":\"Elisabeth R M Heremans, Laura Van den Bulcke, Nabeel Seedat, Astrid Devulder, Pascal Borzée, Bertien Buyse, Dries Testelmans, Maarten Van Den Bossche, Mihaela van der Schaar, Maarten De Vos\",\"doi\":\"10.1111/jsr.14300\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Wearable electroencephalography devices emerge as a cost-effective and ergonomic alternative to gold-standard polysomnography, paving the way for better health monitoring and sleep disorder screening. Machine learning allows to automate sleep stage classification, but trust and reliability issues have hampered its adoption in clinical applications. Estimating uncertainty is a crucial factor in enhancing reliability by identifying regions of heightened and diminished confidence. In this study, we used an uncertainty-centred machine learning pipeline, U-PASS, to automate sleep staging in a challenging real-world dataset of single-channel electroencephalography and accelerometry collected with a wearable device from an elderly population. We were able to effectively limit the uncertainty of our machine learning model and to reliably inform clinical experts of which predictions were uncertain to improve the machine learning model's reliability. This increased the five-stage sleep-scoring accuracy of a state-of-the-art machine learning model from 63.9% to 71.2% on our dataset. Remarkably, the machine learning approach outperformed the human expert in interpreting these wearable data. Manual review by sleep specialists, without specific training for sleep staging on wearable electroencephalography, proved ineffective. The clinical utility of this automated remote monitoring system was also demonstrated, establishing a strong correlation between the predicted sleep parameters and the reference polysomnography parameters, and reproducing known correlations with the apnea-hypopnea index. In essence, this work presents a promising avenue to revolutionize remote patient care through the power of machine learning by the use of an automated data-processing pipeline enhanced with uncertainty estimation.</p>\",\"PeriodicalId\":17057,\"journal\":{\"name\":\"Journal of Sleep Research\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2024-08-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Sleep Research\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1111/jsr.14300\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"CLINICAL NEUROLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Sleep Research","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1111/jsr.14300","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0

摘要

可穿戴式脑电图设备作为黄金标准多导睡眠图的替代品,具有成本效益和人体工程学特性,为更好地监测健康状况和筛查睡眠障碍铺平了道路。机器学习可以自动进行睡眠阶段分类,但信任和可靠性问题阻碍了它在临床应用中的采用。估计不确定性是通过识别可信度提高和降低的区域来提高可靠性的关键因素。在本研究中,我们使用了以不确定性为中心的机器学习管道 U-PASS,在一个具有挑战性的真实世界数据集中自动进行睡眠分期,该数据集是用可穿戴设备从老年人群中收集的单通道脑电图和加速度测量数据。我们能够有效地限制机器学习模型的不确定性,并可靠地告知临床专家哪些预测是不确定的,从而提高机器学习模型的可靠性。在我们的数据集上,这将最先进的机器学习模型的五阶段睡眠评分准确率从 63.9% 提高到 71.2%。值得注意的是,在解释这些可穿戴数据方面,机器学习方法优于人类专家。事实证明,没有接受过可穿戴脑电图睡眠分期专门培训的睡眠专家进行人工审查是无效的。这一自动远程监测系统的临床实用性也得到了证明,它在预测的睡眠参数和参考多导睡眠图参数之间建立了很强的相关性,并再现了已知的与呼吸暂停-低通气指数之间的相关性。从本质上讲,这项工作提供了一条大有可为的途径,利用机器学习的力量,通过不确定性估计增强自动数据处理管道,彻底改变远程病人护理。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Automated remote sleep monitoring needs uncertainty quantification.

Wearable electroencephalography devices emerge as a cost-effective and ergonomic alternative to gold-standard polysomnography, paving the way for better health monitoring and sleep disorder screening. Machine learning allows to automate sleep stage classification, but trust and reliability issues have hampered its adoption in clinical applications. Estimating uncertainty is a crucial factor in enhancing reliability by identifying regions of heightened and diminished confidence. In this study, we used an uncertainty-centred machine learning pipeline, U-PASS, to automate sleep staging in a challenging real-world dataset of single-channel electroencephalography and accelerometry collected with a wearable device from an elderly population. We were able to effectively limit the uncertainty of our machine learning model and to reliably inform clinical experts of which predictions were uncertain to improve the machine learning model's reliability. This increased the five-stage sleep-scoring accuracy of a state-of-the-art machine learning model from 63.9% to 71.2% on our dataset. Remarkably, the machine learning approach outperformed the human expert in interpreting these wearable data. Manual review by sleep specialists, without specific training for sleep staging on wearable electroencephalography, proved ineffective. The clinical utility of this automated remote monitoring system was also demonstrated, establishing a strong correlation between the predicted sleep parameters and the reference polysomnography parameters, and reproducing known correlations with the apnea-hypopnea index. In essence, this work presents a promising avenue to revolutionize remote patient care through the power of machine learning by the use of an automated data-processing pipeline enhanced with uncertainty estimation.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Sleep Research
Journal of Sleep Research 医学-临床神经学
CiteScore
9.00
自引率
6.80%
发文量
234
审稿时长
6-12 weeks
期刊介绍: The Journal of Sleep Research is dedicated to basic and clinical sleep research. The Journal publishes original research papers and invited reviews in all areas of sleep research (including biological rhythms). The Journal aims to promote the exchange of ideas between basic and clinical sleep researchers coming from a wide range of backgrounds and disciplines. The Journal will achieve this by publishing papers which use multidisciplinary and novel approaches to answer important questions about sleep, as well as its disorders and the treatment thereof.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信