Frederik Massie, Steven Vits, Johan Verbraecken, Jeroen Bergmann
{"title":"Context-aware analysis enhances autoscoring accuracy of home sleep apnea testing.","authors":"Frederik Massie, Steven Vits, Johan Verbraecken, Jeroen Bergmann","doi":"10.5664/jcsm.11534","DOIUrl":null,"url":null,"abstract":"<p><strong>Study objectives: </strong>Home sleep apnea testing based on peripheral arterial tonometry (P-HSAT) is increasingly being deployed because of its ability to test for multiple nights. However, P-HSATs do not have access to modalities such as airflow and cortical arousals and instead rely on alternative sources of information to detect respiratory events. This results in an a-priori performance disadvantage. In this study, we describe the Panorama algorithm, which aims to reduce this disadvantage by incorporating information from characteristically repetitive sequences in physiological changes associated with respiratory events. These include changes in peripheral arterial tone, pulse rate, and oxygen saturation. The method was designed to facilitate manual review by providing the scoring rationale for each respiratory event.</p><p><strong>Methods: </strong>The method was developed and evaluated using a dataset of 266 participants from a multicentric cohort suspected of having obstructive sleep apnea (OSA). All participants underwent simultaneous polysomnography (PSG) and P-HSAT, and all PSG data were double-scored. Scoring was performed according to the 3% and 4% rules for hypopnea scoring. Clinical endpoint parameters, including the OSA severity categorization accuracy and Cohen's Kappa, were selected to compare the algorithm to a conventional context-unaware algorithm. Data analysis and reporting followed the TRIPOD+AI reporting guidance for prediction models that use machine learning.</p><p><strong>Results: </strong>Regarding OSA severity categorization accuracy, the Panorama algorithm significantly outperformed context-unaware autoscoring by 9% using 3% rule scoring and 7% using 4% rule scoring.</p><p><strong>Conclusions: </strong>The context-aware method significantly improves the performance of P-HSAT while still facilitating scoring review by providing event-specific scoring rationale.</p><p><strong>Clinical trial registration: </strong>Registry: ClinicalTrials.gov; Title: A Validation Study of the NightOwl PAT-based Home Sleep Apnea Test; Identifier: NCT04191668; URL: https://clinicaltrials.gov/ct2/show/NCT04191668.</p>","PeriodicalId":50233,"journal":{"name":"Journal of Clinical Sleep Medicine","volume":" ","pages":""},"PeriodicalIF":3.5000,"publicationDate":"2025-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Clinical Sleep Medicine","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.5664/jcsm.11534","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Study objectives: Home sleep apnea testing based on peripheral arterial tonometry (P-HSAT) is increasingly being deployed because of its ability to test for multiple nights. However, P-HSATs do not have access to modalities such as airflow and cortical arousals and instead rely on alternative sources of information to detect respiratory events. This results in an a-priori performance disadvantage. In this study, we describe the Panorama algorithm, which aims to reduce this disadvantage by incorporating information from characteristically repetitive sequences in physiological changes associated with respiratory events. These include changes in peripheral arterial tone, pulse rate, and oxygen saturation. The method was designed to facilitate manual review by providing the scoring rationale for each respiratory event.
Methods: The method was developed and evaluated using a dataset of 266 participants from a multicentric cohort suspected of having obstructive sleep apnea (OSA). All participants underwent simultaneous polysomnography (PSG) and P-HSAT, and all PSG data were double-scored. Scoring was performed according to the 3% and 4% rules for hypopnea scoring. Clinical endpoint parameters, including the OSA severity categorization accuracy and Cohen's Kappa, were selected to compare the algorithm to a conventional context-unaware algorithm. Data analysis and reporting followed the TRIPOD+AI reporting guidance for prediction models that use machine learning.
Results: Regarding OSA severity categorization accuracy, the Panorama algorithm significantly outperformed context-unaware autoscoring by 9% using 3% rule scoring and 7% using 4% rule scoring.
Conclusions: The context-aware method significantly improves the performance of P-HSAT while still facilitating scoring review by providing event-specific scoring rationale.
Clinical trial registration: Registry: ClinicalTrials.gov; Title: A Validation Study of the NightOwl PAT-based Home Sleep Apnea Test; Identifier: NCT04191668; URL: https://clinicaltrials.gov/ct2/show/NCT04191668.
期刊介绍:
Journal of Clinical Sleep Medicine focuses on clinical sleep medicine. Its emphasis is publication of papers with direct applicability and/or relevance to the clinical practice of sleep medicine. This includes clinical trials, clinical reviews, clinical commentary and debate, medical economic/practice perspectives, case series and novel/interesting case reports. In addition, the journal will publish proceedings from conferences, workshops and symposia sponsored by the American Academy of Sleep Medicine or other organizations related to improving the practice of sleep medicine.