基于卷积神经网络的多模态人脸图像情感识别

Minli Wen
{"title":"基于卷积神经网络的多模态人脸图像情感识别","authors":"Minli Wen","doi":"10.1117/12.2667333","DOIUrl":null,"url":null,"abstract":"In the background of changing angle and multi-dimensional posture overlapping, it is necessary to extract and recognize the emotion of multi-modal face images, so as to improve the expression ability of facial emotion. A method of emotion recognition of multi-modal face images under changing angle and multi-dimensional posture overlapping background based on convolution neural network and morphological feature parameter recognition is proposed. Constructing a face feature collection model with variable angle and multi-dimensional posture overlapping background, performing fusion filtering on the collected face images with variable angle and multi-dimensional posture overlapping background, extracting the edge contour feature quantity of the face images with variable angle and multi-dimensional posture overlapping background, and filtering and denoising the original image by using morphological convolution neural network transformation method, Multi-modal wavelet scale decomposition method is used to decompose the emotion features of multi-modal face images under the background of changing angles and multi-dimensional postures, and the detection model of pixel points and similarity features of multi-modal face images under the background of changing angles and multi-dimensional postures is constructed. Morphological convolution neural network transformation method is used to transform the emotion features of multi-modal face images, and edge corner detection and expression feature point clustering analysis are combined to realize the emotion recognition of multi-modal face images. The simulation results show that this method has good performance in feature extraction and clustering of multimodal facial image emotion recognition, good expression ability of facial emotion and high image quality.","PeriodicalId":128051,"journal":{"name":"Third International Seminar on Artificial Intelligence, Networking, and Information Technology","volume":"27 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-02-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Emotion recognition of multimodal face images based on convolutional neural network\",\"authors\":\"Minli Wen\",\"doi\":\"10.1117/12.2667333\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the background of changing angle and multi-dimensional posture overlapping, it is necessary to extract and recognize the emotion of multi-modal face images, so as to improve the expression ability of facial emotion. A method of emotion recognition of multi-modal face images under changing angle and multi-dimensional posture overlapping background based on convolution neural network and morphological feature parameter recognition is proposed. Constructing a face feature collection model with variable angle and multi-dimensional posture overlapping background, performing fusion filtering on the collected face images with variable angle and multi-dimensional posture overlapping background, extracting the edge contour feature quantity of the face images with variable angle and multi-dimensional posture overlapping background, and filtering and denoising the original image by using morphological convolution neural network transformation method, Multi-modal wavelet scale decomposition method is used to decompose the emotion features of multi-modal face images under the background of changing angles and multi-dimensional postures, and the detection model of pixel points and similarity features of multi-modal face images under the background of changing angles and multi-dimensional postures is constructed. Morphological convolution neural network transformation method is used to transform the emotion features of multi-modal face images, and edge corner detection and expression feature point clustering analysis are combined to realize the emotion recognition of multi-modal face images. The simulation results show that this method has good performance in feature extraction and clustering of multimodal facial image emotion recognition, good expression ability of facial emotion and high image quality.\",\"PeriodicalId\":128051,\"journal\":{\"name\":\"Third International Seminar on Artificial Intelligence, Networking, and Information Technology\",\"volume\":\"27 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-02-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Third International Seminar on Artificial Intelligence, Networking, and Information Technology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2667333\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Third International Seminar on Artificial Intelligence, Networking, and Information Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2667333","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

在角度变化和多维姿态重叠的背景下,有必要对多模态人脸图像的情感进行提取和识别,以提高面部情感的表达能力。提出了一种基于卷积神经网络和形态特征参数识别的多模态变角度和多维姿态重叠背景下人脸图像情绪识别方法。构建变角度、多维姿态背景叠加的人脸特征采集模型,对采集到的变角度、多维姿态背景叠加的人脸图像进行融合滤波,提取变角度、多维姿态背景叠加的人脸图像边缘轮廓特征量;利用形态学卷积神经网络变换方法对原始图像进行滤波去噪,利用多模态小波尺度分解方法对变换角度和多维姿态背景下多模态人脸图像的情感特征进行分解,构建变换角度和多维姿态背景下多模态人脸图像像素点和相似特征检测模型。采用形态学卷积神经网络变换方法对多模态人脸图像的情感特征进行变换,并结合边缘角检测和表情特征点聚类分析实现多模态人脸图像的情感识别。仿真结果表明,该方法在多模态人脸图像情感识别的特征提取和聚类方面具有良好的性能,具有良好的面部情感表达能力和较高的图像质量。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Emotion recognition of multimodal face images based on convolutional neural network
In the background of changing angle and multi-dimensional posture overlapping, it is necessary to extract and recognize the emotion of multi-modal face images, so as to improve the expression ability of facial emotion. A method of emotion recognition of multi-modal face images under changing angle and multi-dimensional posture overlapping background based on convolution neural network and morphological feature parameter recognition is proposed. Constructing a face feature collection model with variable angle and multi-dimensional posture overlapping background, performing fusion filtering on the collected face images with variable angle and multi-dimensional posture overlapping background, extracting the edge contour feature quantity of the face images with variable angle and multi-dimensional posture overlapping background, and filtering and denoising the original image by using morphological convolution neural network transformation method, Multi-modal wavelet scale decomposition method is used to decompose the emotion features of multi-modal face images under the background of changing angles and multi-dimensional postures, and the detection model of pixel points and similarity features of multi-modal face images under the background of changing angles and multi-dimensional postures is constructed. Morphological convolution neural network transformation method is used to transform the emotion features of multi-modal face images, and edge corner detection and expression feature point clustering analysis are combined to realize the emotion recognition of multi-modal face images. The simulation results show that this method has good performance in feature extraction and clustering of multimodal facial image emotion recognition, good expression ability of facial emotion and high image quality.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信