An EEG signal-based music treatment system for autistic children using edge computing devices

IF 2.1 4区 计算机科学 Q3 COMPUTER SCIENCE, INFORMATION SYSTEMS
Mingxu Sun, Lingfeng Xiao, Xiujin Zhu, Peng Zhang, Xianping Niu, Tao Shen, Bin Sun, Yuan Xu
{"title":"An EEG signal-based music treatment system for autistic children using edge computing devices","authors":"Mingxu Sun, Lingfeng Xiao, Xiujin Zhu, Peng Zhang, Xianping Niu, Tao Shen, Bin Sun, Yuan Xu","doi":"10.1007/s11276-024-03826-x","DOIUrl":null,"url":null,"abstract":"<p>This paper proposes a system that applies electroencephalogram (EEG) technology to achieve music intervention therapy. The system can identify emotions of autistic children in real-time and play music considering their emotions as a musical treatment to assist the treatment of music therapists and the principle of playing homogenous music is to finally calm people down. The proposed method firstly collects EEG of autistic children using a 14-channel EMOTIV EPOC + and preprocesses signals through bandpass filtering, wavelet decomposition and reconstruction, then extracts frequency band-power characteristics of reconstructed EEG signals. Later, the data are classified as one of the three types of emotions (positive, middle and negative) using a support vector machine (SVM). The system also displays the recognized emotion type on a user interface and gives real-time emotional state feedback on emotional changes, which helps music therapists to evaluate the treatment and results more conveniently and effectively. Real EEG data are used to conduct the verification of system feasibility which reaches a classification accuracy of 88%. As the Internet of Things develops, the combination of edge computing with Wise Information Technology of 120 (WIT120) becomes a new trend. In this work, we propose a system to combine edge computing devices with cloud computing resources to form the music regulation system for autistic children to meet processing requirements for EEG signals in terms of timeliness and computational performance. In the designed system, preprocessing EEG signals is done in edge nodes then the preprocessed signals are sent to the cloud where frequency band-power characteristics can be extracted as features to be used in SVM. At last, the results are sent to a mobile app or computer software for therapists to evaluate.</p>","PeriodicalId":23750,"journal":{"name":"Wireless Networks","volume":"4 1","pages":""},"PeriodicalIF":2.1000,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Wireless Networks","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s11276-024-03826-x","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

This paper proposes a system that applies electroencephalogram (EEG) technology to achieve music intervention therapy. The system can identify emotions of autistic children in real-time and play music considering their emotions as a musical treatment to assist the treatment of music therapists and the principle of playing homogenous music is to finally calm people down. The proposed method firstly collects EEG of autistic children using a 14-channel EMOTIV EPOC + and preprocesses signals through bandpass filtering, wavelet decomposition and reconstruction, then extracts frequency band-power characteristics of reconstructed EEG signals. Later, the data are classified as one of the three types of emotions (positive, middle and negative) using a support vector machine (SVM). The system also displays the recognized emotion type on a user interface and gives real-time emotional state feedback on emotional changes, which helps music therapists to evaluate the treatment and results more conveniently and effectively. Real EEG data are used to conduct the verification of system feasibility which reaches a classification accuracy of 88%. As the Internet of Things develops, the combination of edge computing with Wise Information Technology of 120 (WIT120) becomes a new trend. In this work, we propose a system to combine edge computing devices with cloud computing resources to form the music regulation system for autistic children to meet processing requirements for EEG signals in terms of timeliness and computational performance. In the designed system, preprocessing EEG signals is done in edge nodes then the preprocessed signals are sent to the cloud where frequency band-power characteristics can be extracted as features to be used in SVM. At last, the results are sent to a mobile app or computer software for therapists to evaluate.

Abstract Image

利用边缘计算设备为自闭症儿童设计基于脑电信号的音乐治疗系统
本文提出了一种应用脑电图(EEG)技术实现音乐干预治疗的系统。该系统可以实时识别自闭症儿童的情绪,并根据其情绪播放音乐,作为音乐治疗辅助音乐治疗师的治疗,播放同质音乐的原理是使人最终平静下来。该方法首先使用 14 通道 EMOTIV EPOC + 采集自闭症儿童的脑电图,通过带通滤波、小波分解和重构对信号进行预处理,然后提取重构脑电信号的频带功率特征。然后,利用支持向量机(SVM)将数据分类为三种情绪类型(积极情绪、中间情绪和消极情绪)之一。系统还将识别出的情绪类型显示在用户界面上,并实时反馈情绪变化状态,从而帮助音乐治疗师更方便有效地评估治疗方法和效果。真实的脑电图数据用于验证系统的可行性,分类准确率达到 88%。随着物联网的发展,边缘计算与 "智慧 120"(WIT120)信息技术的结合成为一种新趋势。在这项工作中,我们提出了一个系统,将边缘计算设备与云计算资源相结合,形成自闭症儿童音乐调节系统,以满足脑电信号在时效性和计算性能方面的处理要求。在所设计的系统中,先在边缘节点上对脑电信号进行预处理,然后将预处理后的信号发送到云端,在云端提取频段-功率特征作为 SVM 的特征。最后,将结果发送到移动应用程序或计算机软件,供治疗师进行评估。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Wireless Networks
Wireless Networks 工程技术-电信学
CiteScore
7.70
自引率
3.30%
发文量
314
审稿时长
5.5 months
期刊介绍: The wireless communication revolution is bringing fundamental changes to data networking, telecommunication, and is making integrated networks a reality. By freeing the user from the cord, personal communications networks, wireless LAN''s, mobile radio networks and cellular systems, harbor the promise of fully distributed mobile computing and communications, any time, anywhere. Focusing on the networking and user aspects of the field, Wireless Networks provides a global forum for archival value contributions documenting these fast growing areas of interest. The journal publishes refereed articles dealing with research, experience and management issues of wireless networks. Its aim is to allow the reader to benefit from experience, problems and solutions described.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信