Emotion Recognition and Intervention Technology for Autistic Children Based on the Fusion of Neural Networks and Biological Signals

Yifei Wang
{"title":"Emotion Recognition and Intervention Technology for Autistic Children Based on the Fusion of Neural Networks and Biological Signals","authors":"Yifei Wang","doi":"10.1016/j.procs.2025.04.243","DOIUrl":null,"url":null,"abstract":"<div><div>Given the significant difficulties that children with autism face in emotion recognition and intervention, there is an urgent need to develop accurate and efficient technical means to improve their social interaction and emotional understanding abilities. This study discusses a biological signal emotion recognition and intervention technology that integrates Convolutional Neural Network (CNN) and Long Short-Term Memory Network (LSTM). First, this paper collects a variety of biological signal data of autistic children in different emotional states, including heart rate, galvanic skin response (GSR) and electroencephalogram (EEG), and preprocesses and extracts features of the data. Next, this paper builds and trains a deep learning model that integrates CNN and LSTM, classifies and analyzes the extracted features into emotional states, and achieves high-precision emotion recognition. Finally, this paper designs personalized intervention strategies based on the recognition results, and provides emotional guidance and intervention to children through a real-time feedback system. In the experimental conclusion, the accuracy of emotion recognition of the proposed fusion model in the training set and the verification set is 97.5% and 94.2% respectively, which is significantly better than the single mode signal processing method. In addition, the personalized intervention strategy based on this model achieved improvements of 45%, 3.8 points, and 4.2 points in reducing the amplitude of emotional fluctuations, enhancing emotional regulation ability, and improving social behavior, respectively, demonstrating the significant advantages and application potential of multimodal biosignal fusion in improving emotion recognition and intervention effects in children with autism.</div></div>","PeriodicalId":20465,"journal":{"name":"Procedia Computer Science","volume":"261 ","pages":"Pages 538-547"},"PeriodicalIF":0.0000,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Procedia Computer Science","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1877050925013456","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Given the significant difficulties that children with autism face in emotion recognition and intervention, there is an urgent need to develop accurate and efficient technical means to improve their social interaction and emotional understanding abilities. This study discusses a biological signal emotion recognition and intervention technology that integrates Convolutional Neural Network (CNN) and Long Short-Term Memory Network (LSTM). First, this paper collects a variety of biological signal data of autistic children in different emotional states, including heart rate, galvanic skin response (GSR) and electroencephalogram (EEG), and preprocesses and extracts features of the data. Next, this paper builds and trains a deep learning model that integrates CNN and LSTM, classifies and analyzes the extracted features into emotional states, and achieves high-precision emotion recognition. Finally, this paper designs personalized intervention strategies based on the recognition results, and provides emotional guidance and intervention to children through a real-time feedback system. In the experimental conclusion, the accuracy of emotion recognition of the proposed fusion model in the training set and the verification set is 97.5% and 94.2% respectively, which is significantly better than the single mode signal processing method. In addition, the personalized intervention strategy based on this model achieved improvements of 45%, 3.8 points, and 4.2 points in reducing the amplitude of emotional fluctuations, enhancing emotional regulation ability, and improving social behavior, respectively, demonstrating the significant advantages and application potential of multimodal biosignal fusion in improving emotion recognition and intervention effects in children with autism.
基于神经网络与生物信号融合的自闭症儿童情绪识别与干预技术
鉴于自闭症儿童在情绪识别和干预方面存在显著困难,迫切需要开发准确、高效的技术手段来提高自闭症儿童的社会交往和情绪理解能力。本研究探讨了一种融合卷积神经网络(CNN)和长短期记忆网络(LSTM)的生物信号情绪识别与干预技术。首先,收集自闭症儿童在不同情绪状态下的各种生物信号数据,包括心率、皮肤电反应(GSR)和脑电图(EEG),并对数据进行预处理和特征提取。接下来,本文构建并训练了一个融合CNN和LSTM的深度学习模型,将提取的特征分类并分析为情绪状态,实现了高精度的情绪识别。最后,根据识别结果设计个性化干预策略,并通过实时反馈系统对儿童进行情感引导和干预。实验结论表明,本文提出的融合模型在训练集和验证集上的情绪识别准确率分别为97.5%和94.2%,明显优于单模信号处理方法。此外,基于该模型的个性化干预策略在降低情绪波动幅度、增强情绪调节能力和改善社会行为方面分别提高了45%、3.8分和4.2分,显示了多模态生物信号融合在提高自闭症儿童情绪识别和干预效果方面的显著优势和应用潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
4.50
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信