利用深度神经网络进行面部情绪识别:视觉几何组-16 (VGG16) 技术与数据增强以提高精度的研究

IF 0.6 Q3 MULTIDISCIPLINARY SCIENCES
Sarthak Kapaliya, Debabrata Swain, Ritu Sharma, Kanishka Varyani, Jyoti Thakar
{"title":"利用深度神经网络进行面部情绪识别:视觉几何组-16 (VGG16) 技术与数据增强以提高精度的研究","authors":"Sarthak Kapaliya, Debabrata Swain, Ritu Sharma, Kanishka Varyani, Jyoti Thakar","doi":"10.47836/pjst.32.5.02","DOIUrl":null,"url":null,"abstract":"Emotions play a significant role in both verbal and nonverbal communication. Facial emotion recognition has applications in various sectors where we can get real-time feedback about student activeness by detecting their expression. In this paper, we aim to provide an improved deep-learning technique to detect emotions by using publicly available datasets to perform this detection. To get more data for the well-being of the Machine Learning Model, we have used data augmentation using the TensorFlow framework. Visual Geometry Group-16 (VGG16) is a convolutional neural network of 16 layers deep. There has been an alteration to the default VGG16 structure to get better classification results. Various optimization algorithms and loss functions increase the model’s accuracy. We have used many evaluation parameters from the technical side, like precision, accuracy, recall, Area Under the Receiver Operating Characteristic Curve (AUC), and F1 Score. The proposed model has an accuracy of 89% while having a precision of 81 percent for classification. We have achieved an F1 Score of 0.42 and an area under the ROC curve (AUC) of 0.734. Overall, it would be beneficial for analyzing and categorizing positive and negative emotions, which would aid in detecting signs of stress, anxiety, and burnout, as well as taking preventive actions to enhance well-being.","PeriodicalId":46234,"journal":{"name":"Pertanika Journal of Science and Technology","volume":null,"pages":null},"PeriodicalIF":0.6000,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Facial Emotion Recognition with Deep Neural Network: A Study of Visual Geometry Group-16 (VGG16) Technique with Data Augmentation for Improved Precision\",\"authors\":\"Sarthak Kapaliya, Debabrata Swain, Ritu Sharma, Kanishka Varyani, Jyoti Thakar\",\"doi\":\"10.47836/pjst.32.5.02\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Emotions play a significant role in both verbal and nonverbal communication. Facial emotion recognition has applications in various sectors where we can get real-time feedback about student activeness by detecting their expression. In this paper, we aim to provide an improved deep-learning technique to detect emotions by using publicly available datasets to perform this detection. To get more data for the well-being of the Machine Learning Model, we have used data augmentation using the TensorFlow framework. Visual Geometry Group-16 (VGG16) is a convolutional neural network of 16 layers deep. There has been an alteration to the default VGG16 structure to get better classification results. Various optimization algorithms and loss functions increase the model’s accuracy. We have used many evaluation parameters from the technical side, like precision, accuracy, recall, Area Under the Receiver Operating Characteristic Curve (AUC), and F1 Score. The proposed model has an accuracy of 89% while having a precision of 81 percent for classification. We have achieved an F1 Score of 0.42 and an area under the ROC curve (AUC) of 0.734. Overall, it would be beneficial for analyzing and categorizing positive and negative emotions, which would aid in detecting signs of stress, anxiety, and burnout, as well as taking preventive actions to enhance well-being.\",\"PeriodicalId\":46234,\"journal\":{\"name\":\"Pertanika Journal of Science and Technology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.6000,\"publicationDate\":\"2024-08-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Pertanika Journal of Science and Technology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.47836/pjst.32.5.02\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"MULTIDISCIPLINARY SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pertanika Journal of Science and Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.47836/pjst.32.5.02","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
引用次数: 0

摘要

情绪在语言和非语言交流中都扮演着重要角色。面部情绪识别在各行各业都有应用,通过检测学生的表情,我们可以获得有关学生活跃程度的实时反馈。在本文中,我们旨在提供一种改进的深度学习技术,通过使用公开可用的数据集来进行情绪检测。为了获取更多数据来改善机器学习模型,我们使用了 TensorFlow 框架来增强数据。Visual Geometry Group-16 (VGG16) 是一个深度为 16 层的卷积神经网络。为了获得更好的分类结果,我们对默认的 VGG16 结构进行了修改。各种优化算法和损失函数提高了模型的准确性。我们使用了许多技术方面的评估参数,如精确度、准确度、召回率、接收者工作特征曲线下面积(AUC)和 F1 分数。建议模型的准确率为 89%,而分类精度为 81%。我们的 F1 得分为 0.42,ROC 曲线下面积(AUC)为 0.734。总体而言,该模型有利于对积极和消极情绪进行分析和分类,这将有助于检测压力、焦虑和职业倦怠的迹象,并采取预防措施来提高幸福感。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Facial Emotion Recognition with Deep Neural Network: A Study of Visual Geometry Group-16 (VGG16) Technique with Data Augmentation for Improved Precision
Emotions play a significant role in both verbal and nonverbal communication. Facial emotion recognition has applications in various sectors where we can get real-time feedback about student activeness by detecting their expression. In this paper, we aim to provide an improved deep-learning technique to detect emotions by using publicly available datasets to perform this detection. To get more data for the well-being of the Machine Learning Model, we have used data augmentation using the TensorFlow framework. Visual Geometry Group-16 (VGG16) is a convolutional neural network of 16 layers deep. There has been an alteration to the default VGG16 structure to get better classification results. Various optimization algorithms and loss functions increase the model’s accuracy. We have used many evaluation parameters from the technical side, like precision, accuracy, recall, Area Under the Receiver Operating Characteristic Curve (AUC), and F1 Score. The proposed model has an accuracy of 89% while having a precision of 81 percent for classification. We have achieved an F1 Score of 0.42 and an area under the ROC curve (AUC) of 0.734. Overall, it would be beneficial for analyzing and categorizing positive and negative emotions, which would aid in detecting signs of stress, anxiety, and burnout, as well as taking preventive actions to enhance well-being.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Pertanika Journal of Science and Technology
Pertanika Journal of Science and Technology MULTIDISCIPLINARY SCIENCES-
CiteScore
1.50
自引率
16.70%
发文量
178
期刊介绍: Pertanika Journal of Science and Technology aims to provide a forum for high quality research related to science and engineering research. Areas relevant to the scope of the journal include: bioinformatics, bioscience, biotechnology and bio-molecular sciences, chemistry, computer science, ecology, engineering, engineering design, environmental control and management, mathematics and statistics, medicine and health sciences, nanotechnology, physics, safety and emergency management, and related fields of study.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信