Baobing Zhang , Paul Sullivan , Benjie Tang , Ghulam Nabi , Mustafa Suphi Erden
{"title":"AutoMedTS: Automated modeling of physiological time series for surgical suturing action recognition","authors":"Baobing Zhang , Paul Sullivan , Benjie Tang , Ghulam Nabi , Mustafa Suphi Erden","doi":"10.1016/j.engappai.2025.112880","DOIUrl":null,"url":null,"abstract":"<div><div>In laparoscopic surgical training and evaluation, real-time recognition of surgical actions with transparency outputs is crucial for automated, objective, and immediate instructional feedback to support skills improvement. However, we face challenges due to limited dataset sizes and variability in surgical environments. This study presents <em>AutoMedTS</em>, an end-to-end automated machine learning framework customized for medical time-series data, enabling rapid deployment using surgical suturing trajectories collected from both expert and novice surgeons. The proposed method features key improvements including: (i) a novel temperature-scaled Softmax resampling technique effectively addressing severe class imbalance, and (ii) an uncertainty-aware ensemble selection mechanism ensuring robust predictions across surgeons with varying skill levels. Additionally, the approach emphasizes model transparency to meet the high standards of reliability and transparency required in medical applications. Compared to deep learning methods, traditional machine learning models not only facilitate efficient rapid deployment but also offer significant transparency advantages. Experimental results demonstrate that our method provides fast, stable, and reliable real-time surgical action recognition in clinical training environments. Code and data are publicly available at <span><span>https://github.com/baobingzhang/AutoMedTS</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"163 ","pages":"Article 112880"},"PeriodicalIF":8.0000,"publicationDate":"2025-10-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197625029112","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
In laparoscopic surgical training and evaluation, real-time recognition of surgical actions with transparency outputs is crucial for automated, objective, and immediate instructional feedback to support skills improvement. However, we face challenges due to limited dataset sizes and variability in surgical environments. This study presents AutoMedTS, an end-to-end automated machine learning framework customized for medical time-series data, enabling rapid deployment using surgical suturing trajectories collected from both expert and novice surgeons. The proposed method features key improvements including: (i) a novel temperature-scaled Softmax resampling technique effectively addressing severe class imbalance, and (ii) an uncertainty-aware ensemble selection mechanism ensuring robust predictions across surgeons with varying skill levels. Additionally, the approach emphasizes model transparency to meet the high standards of reliability and transparency required in medical applications. Compared to deep learning methods, traditional machine learning models not only facilitate efficient rapid deployment but also offer significant transparency advantages. Experimental results demonstrate that our method provides fast, stable, and reliable real-time surgical action recognition in clinical training environments. Code and data are publicly available at https://github.com/baobingzhang/AutoMedTS.
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.