Chanwoo Park, Jung-Ick Byun, Sang Ho Choi, Won Chul Shin
{"title":"Machine learning classifier solving the problem of sleep stage imbalance between overnight sleep.","authors":"Chanwoo Park, Jung-Ick Byun, Sang Ho Choi, Won Chul Shin","doi":"10.1007/s13534-025-00466-8","DOIUrl":null,"url":null,"abstract":"<p><p>Feature extraction follows the American Academy of Sleep Medicine (AASM) sleep score manually and applies it to machine learning with a focus on the generalization of sleep data to enable data-centric artificial intelligence. In real-world clinical testing, the manual scoring of sleep stages is time-consuming and requires significant expertise. Additionally, it is subject to interobserver subjective bias. Machine-learning techniques offer a way to overcome these limitations through automation. However, machine learning for sleep phase prediction can perform poorly for small classes. If the distribution of the training data was unbalanced, the model was trained with a bias toward the majority class. To address this, we experimented with loss function adjustment and resampling methods that assign more weight to the prediction errors of minority classes in sleep scoring to determine how to overcome the data imbalance problem. Machine learning can also be used to compare the accuracy of each channel in identifying electrodes, which should be monitored more closely in real-world clinical testing. Owing to the small amount of data available for machine learning in this study, we used various machine learning classifiers by increasing or decreasing the dataset using sampling techniques and weighting different classes of sleep stages. In our experiments, the best-performing model for classifying sleep stages had an accuracy of 91.9%, kappa of 0.899, and F1-score of 86.9%.</p>","PeriodicalId":46898,"journal":{"name":"Biomedical Engineering Letters","volume":"15 3","pages":"513-523"},"PeriodicalIF":3.2000,"publicationDate":"2025-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12011700/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biomedical Engineering Letters","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1007/s13534-025-00466-8","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/5/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"ENGINEERING, BIOMEDICAL","Score":null,"Total":0}
引用次数: 0
Abstract
Feature extraction follows the American Academy of Sleep Medicine (AASM) sleep score manually and applies it to machine learning with a focus on the generalization of sleep data to enable data-centric artificial intelligence. In real-world clinical testing, the manual scoring of sleep stages is time-consuming and requires significant expertise. Additionally, it is subject to interobserver subjective bias. Machine-learning techniques offer a way to overcome these limitations through automation. However, machine learning for sleep phase prediction can perform poorly for small classes. If the distribution of the training data was unbalanced, the model was trained with a bias toward the majority class. To address this, we experimented with loss function adjustment and resampling methods that assign more weight to the prediction errors of minority classes in sleep scoring to determine how to overcome the data imbalance problem. Machine learning can also be used to compare the accuracy of each channel in identifying electrodes, which should be monitored more closely in real-world clinical testing. Owing to the small amount of data available for machine learning in this study, we used various machine learning classifiers by increasing or decreasing the dataset using sampling techniques and weighting different classes of sleep stages. In our experiments, the best-performing model for classifying sleep stages had an accuracy of 91.9%, kappa of 0.899, and F1-score of 86.9%.
期刊介绍:
Biomedical Engineering Letters (BMEL) aims to present the innovative experimental science and technological development in the biomedical field as well as clinical application of new development. The article must contain original biomedical engineering content, defined as development, theoretical analysis, and evaluation/validation of a new technique. BMEL publishes the following types of papers: original articles, review articles, editorials, and letters to the editor. All the papers are reviewed in single-blind fashion.