Low-resolution facial emotion recognition on low-cost devices

M. D. Putro, Jane Litouw, V. Poekoel
{"title":"Low-resolution facial emotion recognition on low-cost devices","authors":"M. D. Putro, Jane Litouw, V. Poekoel","doi":"10.11591/ijai.v13.i2.pp2201-2211","DOIUrl":null,"url":null,"abstract":"The low-resolution input image is a crucial challenge for applying facial emotion recognition in real-world scenarios. The critical problem is that valuable object features are relatively lost in the extraction process due to their small size. On the other hand, this vision system is required by a machine to run smoothly on low-cost devices. Facial emotion recognition using a lightweight feature extractor is proposed in this study to effectively capture crucial facial components in a low-resolution image. To compromise the running speed, this work offers an efficient feature convolution to discriminate specific facial features. In addition, the system is embedded with an attentive module to capture important features and correlate them. Our model performance is evaluated on low-resolution public datasets achieving the accuracy of 97.34\\%, 81.10\\%, and 80.12\\% on KDEF, RFDB, and FER-plus, respectively. The practical application demands that the deep learning model can operate fast on inexpensive devices. Consequently, the model achieved a speed of 290 FPS on a CPU device.","PeriodicalId":507934,"journal":{"name":"IAES International Journal of Artificial Intelligence (IJ-AI)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IAES International Journal of Artificial Intelligence (IJ-AI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.11591/ijai.v13.i2.pp2201-2211","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

The low-resolution input image is a crucial challenge for applying facial emotion recognition in real-world scenarios. The critical problem is that valuable object features are relatively lost in the extraction process due to their small size. On the other hand, this vision system is required by a machine to run smoothly on low-cost devices. Facial emotion recognition using a lightweight feature extractor is proposed in this study to effectively capture crucial facial components in a low-resolution image. To compromise the running speed, this work offers an efficient feature convolution to discriminate specific facial features. In addition, the system is embedded with an attentive module to capture important features and correlate them. Our model performance is evaluated on low-resolution public datasets achieving the accuracy of 97.34\%, 81.10\%, and 80.12\% on KDEF, RFDB, and FER-plus, respectively. The practical application demands that the deep learning model can operate fast on inexpensive devices. Consequently, the model achieved a speed of 290 FPS on a CPU device.
低成本设备上的低分辨率面部情绪识别
低分辨率输入图像是在现实世界场景中应用面部情绪识别的关键挑战。问题的关键在于,由于图像尺寸较小,有价值的对象特征在提取过程中会相对丢失。另一方面,机器要求这种视觉系统能在低成本设备上流畅运行。本研究提出使用轻量级特征提取器进行面部情绪识别,以有效捕捉低分辨率图像中的关键面部组件。为了降低运行速度,本研究提供了一种高效的特征卷积方法来识别特定的面部特征。此外,该系统还嵌入了一个细心模块,以捕捉重要特征并将其关联起来。我们在低分辨率公共数据集上对模型性能进行了评估,在KDEF、RFDB和FER-plus上的准确率分别达到97.34%、81.10%和80.12%。实际应用要求深度学习模型能够在廉价设备上快速运行。因此,该模型在 CPU 设备上的运行速度达到了 290 FPS。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信