基于立方体变压器的咳嗽病分类系统设计

Y. Chen, Chih-Shun Hsu, Bo-Xuan Yang
{"title":"基于立方体变压器的咳嗽病分类系统设计","authors":"Y. Chen, Chih-Shun Hsu, Bo-Xuan Yang","doi":"10.1109/SmartNets58706.2023.10215518","DOIUrl":null,"url":null,"abstract":"Cough is a common symptom of respiratory diseases. Hence, making a correct diagnosis of the respiratory diseases through cough classification is an important issue. The current methods for diagnosing COVID-19 include rapid screening and PCR testing. However, the cost of the above approaches is high and require the contact with patients and there is a risk of infection. Most patients diagnosed with COVID-19 have cough symptoms. Hence, diagnosis based on cough sounds is a cheaper and safer approach. In order to improve the quality of training data, the data conversion method of MFCCs is used in the preprocessing of the data. The target data is extracted from the sound data and then projected into the image data, and the sound is analyzed for the diagnosis of the respiratory diseases. Regarding the AI model for calculating the correlation between different data, the self-attention operation mechanism in Transformer can calculate the degree of the correlation between sequence nodes. Therefore, the Transformer model originally used in the translation field is used as the basis for improvement. Based on the concept of hypercube, a self-attention architecture with hypercube characteristics is proposed, which is named as Cube-Transformer. The Cube-Transformer model is mainly optimized and improved from the self-attention operation mechanism and the Star-Transformer model. The Cube-Transformer model can provide data with different self-attention computation scores on different planes and pay attention to the correlation of different data spaces. The experimental results show that the Cube-Transformer model can learn more feature aspects than the Star-Transformer model does and thus improve the identification accuracy by 1.5%.","PeriodicalId":301834,"journal":{"name":"2023 International Conference on Smart Applications, Communications and Networking (SmartNets)","volume":"20 8 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The Design of a Cough Disease Classification System Using Cube-Transformer\",\"authors\":\"Y. Chen, Chih-Shun Hsu, Bo-Xuan Yang\",\"doi\":\"10.1109/SmartNets58706.2023.10215518\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Cough is a common symptom of respiratory diseases. Hence, making a correct diagnosis of the respiratory diseases through cough classification is an important issue. The current methods for diagnosing COVID-19 include rapid screening and PCR testing. However, the cost of the above approaches is high and require the contact with patients and there is a risk of infection. Most patients diagnosed with COVID-19 have cough symptoms. Hence, diagnosis based on cough sounds is a cheaper and safer approach. In order to improve the quality of training data, the data conversion method of MFCCs is used in the preprocessing of the data. The target data is extracted from the sound data and then projected into the image data, and the sound is analyzed for the diagnosis of the respiratory diseases. Regarding the AI model for calculating the correlation between different data, the self-attention operation mechanism in Transformer can calculate the degree of the correlation between sequence nodes. Therefore, the Transformer model originally used in the translation field is used as the basis for improvement. Based on the concept of hypercube, a self-attention architecture with hypercube characteristics is proposed, which is named as Cube-Transformer. The Cube-Transformer model is mainly optimized and improved from the self-attention operation mechanism and the Star-Transformer model. The Cube-Transformer model can provide data with different self-attention computation scores on different planes and pay attention to the correlation of different data spaces. The experimental results show that the Cube-Transformer model can learn more feature aspects than the Star-Transformer model does and thus improve the identification accuracy by 1.5%.\",\"PeriodicalId\":301834,\"journal\":{\"name\":\"2023 International Conference on Smart Applications, Communications and Networking (SmartNets)\",\"volume\":\"20 8 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-07-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 International Conference on Smart Applications, Communications and Networking (SmartNets)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/SmartNets58706.2023.10215518\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 International Conference on Smart Applications, Communications and Networking (SmartNets)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SmartNets58706.2023.10215518","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

咳嗽是呼吸系统疾病的常见症状。因此,通过咳嗽分类对呼吸道疾病进行正确诊断是一个重要的问题。目前的诊断方法包括快速筛查和PCR检测。然而,上述方法费用高,需要与患者接触,并且存在感染风险。大多数被诊断为COVID-19的患者都有咳嗽症状。因此,根据咳嗽声进行诊断是一种更便宜、更安全的方法。为了提高训练数据的质量,在数据预处理中采用了mfccc的数据转换方法。从声音数据中提取目标数据,然后投影到图像数据中,对声音进行分析,用于呼吸系统疾病的诊断。对于计算不同数据之间关联的AI模型,Transformer中的自关注运行机制可以计算序列节点之间的关联程度。因此,最初在翻译领域中使用的Transformer模型被用作改进的基础。基于超立方体的概念,提出了一种具有超立方体特征的自关注体系结构,并将其命名为Cube-Transformer。Cube-Transformer模型主要从自关注运行机制和Star-Transformer模型两方面进行优化和改进。Cube-Transformer模型可以在不同平面上提供不同自注意计算分数的数据,并关注不同数据空间的相关性。实验结果表明,与Star-Transformer模型相比,Cube-Transformer模型可以学习到更多的特征方面,从而将识别精度提高1.5%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
The Design of a Cough Disease Classification System Using Cube-Transformer
Cough is a common symptom of respiratory diseases. Hence, making a correct diagnosis of the respiratory diseases through cough classification is an important issue. The current methods for diagnosing COVID-19 include rapid screening and PCR testing. However, the cost of the above approaches is high and require the contact with patients and there is a risk of infection. Most patients diagnosed with COVID-19 have cough symptoms. Hence, diagnosis based on cough sounds is a cheaper and safer approach. In order to improve the quality of training data, the data conversion method of MFCCs is used in the preprocessing of the data. The target data is extracted from the sound data and then projected into the image data, and the sound is analyzed for the diagnosis of the respiratory diseases. Regarding the AI model for calculating the correlation between different data, the self-attention operation mechanism in Transformer can calculate the degree of the correlation between sequence nodes. Therefore, the Transformer model originally used in the translation field is used as the basis for improvement. Based on the concept of hypercube, a self-attention architecture with hypercube characteristics is proposed, which is named as Cube-Transformer. The Cube-Transformer model is mainly optimized and improved from the self-attention operation mechanism and the Star-Transformer model. The Cube-Transformer model can provide data with different self-attention computation scores on different planes and pay attention to the correlation of different data spaces. The experimental results show that the Cube-Transformer model can learn more feature aspects than the Star-Transformer model does and thus improve the identification accuracy by 1.5%.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信