Donghyeok Kim, Jeong Yup Han, Hyunjun Jung, Da Yeun Song, Changhee Lee, Gwanghui Ryu, Sang Duk Hong, Hyo-Yeol Kim, Yong Gi Jung
{"title":"AI‑Enhanced Smartwatch AHI Estimation and AI‑Scored Polysomnography for Obstructive Sleep Apnea: Real‑World Validation.","authors":"Donghyeok Kim, Jeong Yup Han, Hyunjun Jung, Da Yeun Song, Changhee Lee, Gwanghui Ryu, Sang Duk Hong, Hyo-Yeol Kim, Yong Gi Jung","doi":"10.2147/NSS.S540460","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>This study validated the accuracy of an artificial‑intelligence (AI) smartwatch algorithm that directly estimates the apnea-hypopnea index (AHI) by comparing its performance with AI-scored Level 1 polysomnography (PSG) in Korean adults. The model was trained in South‑American cohorts, allowing inter‑ethnic validation.</p><p><strong>Methods: </strong>A total of 90 adults underwent simultaneous Level 1 PSG and smartwatch recording. Fifty‑three datasets with ≥ 3 hours of valid watch data were analyzed. AHI values were obtained as follows: expert‑scored PSG (pAHI), AI‑scored PSG (aiAHI), and smartwatch output (eAHI). Agreement was assessed with Spearman correlation, intraclass correlation coefficients, and receiver‑operating‑characteristic curves.</p><p><strong>Results: </strong>eAHI correlated strongly with aiAHI (<i>ρ</i> = 0.88, ICC = 0.87) and pAHI (<i>ρ</i> = 0.85, ICC = 0.82). For detecting moderate‑to‑severe OSA (aiAHI ≥ 15 events/h), the smartwatch algorithm yielded 92.3% sensitivity, 92.6% specificity, and 92.5% overall accuracy. Bland-Altman analysis revealed systematic underestimation of actual AHI by the smartwatch, particularly in mild OSA.</p><p><strong>Conclusion: </strong>This study demonstrates that the evaluated smartwatch-based AHI estimation algorithm shows high concordance with PSG-derived values, particularly for the detection and classification of moderate to severe OSA. However, it should be noted that this smartwatch algorithm tends to underestimate the AHI of OSA due to limitations in scoring unit and recording duration calculation. These findings support the clinical utility of wearable technology as a practical and scalable tool for early identification and longitudinal monitoring of OSA in real-world environments, while highlighting the need for further optimization to accurately detect mild cases.</p>","PeriodicalId":18896,"journal":{"name":"Nature and Science of Sleep","volume":"17 ","pages":"2297-2307"},"PeriodicalIF":3.4000,"publicationDate":"2025-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12474664/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nature and Science of Sleep","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.2147/NSS.S540460","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: This study validated the accuracy of an artificial‑intelligence (AI) smartwatch algorithm that directly estimates the apnea-hypopnea index (AHI) by comparing its performance with AI-scored Level 1 polysomnography (PSG) in Korean adults. The model was trained in South‑American cohorts, allowing inter‑ethnic validation.
Methods: A total of 90 adults underwent simultaneous Level 1 PSG and smartwatch recording. Fifty‑three datasets with ≥ 3 hours of valid watch data were analyzed. AHI values were obtained as follows: expert‑scored PSG (pAHI), AI‑scored PSG (aiAHI), and smartwatch output (eAHI). Agreement was assessed with Spearman correlation, intraclass correlation coefficients, and receiver‑operating‑characteristic curves.
Results: eAHI correlated strongly with aiAHI (ρ = 0.88, ICC = 0.87) and pAHI (ρ = 0.85, ICC = 0.82). For detecting moderate‑to‑severe OSA (aiAHI ≥ 15 events/h), the smartwatch algorithm yielded 92.3% sensitivity, 92.6% specificity, and 92.5% overall accuracy. Bland-Altman analysis revealed systematic underestimation of actual AHI by the smartwatch, particularly in mild OSA.
Conclusion: This study demonstrates that the evaluated smartwatch-based AHI estimation algorithm shows high concordance with PSG-derived values, particularly for the detection and classification of moderate to severe OSA. However, it should be noted that this smartwatch algorithm tends to underestimate the AHI of OSA due to limitations in scoring unit and recording duration calculation. These findings support the clinical utility of wearable technology as a practical and scalable tool for early identification and longitudinal monitoring of OSA in real-world environments, while highlighting the need for further optimization to accurately detect mild cases.
期刊介绍:
Nature and Science of Sleep is an international, peer-reviewed, open access journal covering all aspects of sleep science and sleep medicine, including the neurophysiology and functions of sleep, the genetics of sleep, sleep and society, biological rhythms, dreaming, sleep disorders and therapy, and strategies to optimize healthy sleep.
Specific topics covered in the journal include:
The functions of sleep in humans and other animals
Physiological and neurophysiological changes with sleep
The genetics of sleep and sleep differences
The neurotransmitters, receptors and pathways involved in controlling both sleep and wakefulness
Behavioral and pharmacological interventions aimed at improving sleep, and improving wakefulness
Sleep changes with development and with age
Sleep and reproduction (e.g., changes across the menstrual cycle, with pregnancy and menopause)
The science and nature of dreams
Sleep disorders
Impact of sleep and sleep disorders on health, daytime function and quality of life
Sleep problems secondary to clinical disorders
Interaction of society with sleep (e.g., consequences of shift work, occupational health, public health)
The microbiome and sleep
Chronotherapy
Impact of circadian rhythms on sleep, physiology, cognition and health
Mechanisms controlling circadian rhythms, centrally and peripherally
Impact of circadian rhythm disruptions (including night shift work, jet lag and social jet lag) on sleep, physiology, cognition and health
Behavioral and pharmacological interventions aimed at reducing adverse effects of circadian-related sleep disruption
Assessment of technologies and biomarkers for measuring sleep and/or circadian rhythms
Epigenetic markers of sleep or circadian disruption.