Smartphone-based intelligent system with a wearable throat microphone for real-time screening of swallowing ability.

Ye Li, Yacen Wu, Qiang Tang, Haijun Lin, Juanjuan Fu, Yuxiang Yang, Fu Zhang
{"title":"Smartphone-based intelligent system with a wearable throat microphone for real-time screening of swallowing ability.","authors":"Ye Li, Yacen Wu, Qiang Tang, Haijun Lin, Juanjuan Fu, Yuxiang Yang, Fu Zhang","doi":"10.1515/bmt-2025-0028","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>Accurate and timely swallowing ability screening is essential for effective prevention and treatment of dysphagia. Current clinical imaging methods are often radioactive or invasive, limiting their applicability for routine monitoring. This study aims to develop a smartphone-based intelligent system for real-time screening of swallowing ability using a wearable throat microphone.</p><p><strong>Methods: </strong>First, a customized Android application was developed to collect, visualize, and analyze sounds related to swallowing from a wearable throat microphone. Second, a transfer learning model, YAMNet-S, was trained on 4,715 one-second audio segments of coughing, swallowing, and other noises, obtained from 215 healthy participants (Experiment 1). The trained model was then deployed on a smartphone to classify swallowing-related events in real time. Finally, the water swallow test (WST) was conducted by counting swallowing and coughing events within 30 s from 15 simulated patients with self-induced voluntary coughs for clinical validation (Experiment 2).</p><p><strong>Results: </strong>The mean accuracy of the trained model in swallowing and coughing events classification is 94.48 and 94.45 %, respectively, and the difference of WST scores in system calculations and expert evaluation was 0.267 (out of 5).</p><p><strong>Conclusions: </strong>This smartphone-based intelligent system has the potential to be a comfort, portability and user-friendliness tool for preliminary screening of dysphagia before VFSS/FEES, especially on some situations with limited medical resources, such as community or home-based care.</p>","PeriodicalId":93905,"journal":{"name":"Biomedizinische Technik. Biomedical engineering","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2025-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biomedizinische Technik. Biomedical engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1515/bmt-2025-0028","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Objectives: Accurate and timely swallowing ability screening is essential for effective prevention and treatment of dysphagia. Current clinical imaging methods are often radioactive or invasive, limiting their applicability for routine monitoring. This study aims to develop a smartphone-based intelligent system for real-time screening of swallowing ability using a wearable throat microphone.

Methods: First, a customized Android application was developed to collect, visualize, and analyze sounds related to swallowing from a wearable throat microphone. Second, a transfer learning model, YAMNet-S, was trained on 4,715 one-second audio segments of coughing, swallowing, and other noises, obtained from 215 healthy participants (Experiment 1). The trained model was then deployed on a smartphone to classify swallowing-related events in real time. Finally, the water swallow test (WST) was conducted by counting swallowing and coughing events within 30 s from 15 simulated patients with self-induced voluntary coughs for clinical validation (Experiment 2).

Results: The mean accuracy of the trained model in swallowing and coughing events classification is 94.48 and 94.45 %, respectively, and the difference of WST scores in system calculations and expert evaluation was 0.267 (out of 5).

Conclusions: This smartphone-based intelligent system has the potential to be a comfort, portability and user-friendliness tool for preliminary screening of dysphagia before VFSS/FEES, especially on some situations with limited medical resources, such as community or home-based care.

基于智能手机的智能系统,带有可穿戴喉部麦克风,用于实时筛查吞咽能力。
目的:准确、及时的吞咽能力筛查是有效预防和治疗吞咽困难的必要条件。目前的临床成像方法通常具有放射性或侵入性,限制了它们在常规监测中的适用性。本研究旨在开发一种基于智能手机的智能系统,用于使用可穿戴喉部麦克风实时筛查吞咽能力。方法:首先,开发了一个定制的Android应用程序来收集、可视化和分析与可穿戴喉部麦克风吞咽相关的声音。其次,对迁移学习模型YAMNet-S进行训练,该模型使用了来自215名健康参与者的4,715段一秒钟的咳嗽、吞咽和其他噪音音频片段(实验1)。经过训练的模型随后被部署在智能手机上,对吞咽相关事件进行实时分类。最后,进行水吞试验(water swallow test, WST),对15例自我诱导自愿咳嗽的模拟患者在30 s内的吞咽和咳嗽次数进行计数,进行临床验证(实验2)。结果:所训练模型在吞咽和咳嗽事件分类上的平均准确率分别为94.48和94.45 %,WST评分在系统计算和专家评价上的差值为0.267(满分5分)。结论:这种基于智能手机的智能系统有可能成为一种舒适、便携和用户友好的工具,用于在VFSS/FEES前对吞咽困难进行初步筛查,特别是在一些医疗资源有限的情况下,如社区或家庭护理。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信