A Comprehensive Review of Microexpression Recognition, Classification, and Datasets

IF 4.6 2区 计算机科学 Q1 COMPUTER SCIENCE, CYBERNETICS
Parul Malik;Jaiteg Singh;Farman Ali;Daehan Kwak
{"title":"A Comprehensive Review of Microexpression Recognition, Classification, and Datasets","authors":"Parul Malik;Jaiteg Singh;Farman Ali;Daehan Kwak","doi":"10.1109/TCSS.2026.3672552","DOIUrl":null,"url":null,"abstract":"Facial microexpressions (MEs) are brief, involuntary facial movements that reveal genuine emotions a person attempts to suppress or conceal. Their short duration and low intensity pose considerable challenges for human observers and automated recognition systems, yet MEs hold practical value in psychotherapy, deception detection, marketing, and public safety. Several surveys have reviewed ME recognition, but most are primarily descriptive and lack systematic frameworks for literature selection and analysis. They also tend to overlook how individual, expression-related, and contextual factors shape recognition outcomes. This study addresses these limitations through a preferred reporting items for systematic reviews and meta-analyses (PRISMA)-based systematic review of ME recognition research published between 2015 and 2025, covering preprocessing methods, feature representation, and dataset characteristics. The review critically compares existing approaches, weighing their strengths, limitations, and suitability for real-world deployment. It examines persistent challenges, including dataset imbalance, limited cross-dataset generalization, and underexplored temporal dynamics, alongside emerging directions in action unit-based, multimodal, and deep learning methods. Specific recommendations for future work aimed at closing the gap between laboratory findings and practical application are also provided. By grounding the analysis in transparent selection criteria and structured synthesis, this work offers a reproducible foundation for advancing ME recognition research.","PeriodicalId":13044,"journal":{"name":"IEEE Transactions on Computational Social Systems","volume":"13 5","pages":"6212-6227"},"PeriodicalIF":4.6000,"publicationDate":"2026-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Computational Social Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11509641/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/3/6 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, CYBERNETICS","Score":null,"Total":0}
引用次数: 0

Abstract

Facial microexpressions (MEs) are brief, involuntary facial movements that reveal genuine emotions a person attempts to suppress or conceal. Their short duration and low intensity pose considerable challenges for human observers and automated recognition systems, yet MEs hold practical value in psychotherapy, deception detection, marketing, and public safety. Several surveys have reviewed ME recognition, but most are primarily descriptive and lack systematic frameworks for literature selection and analysis. They also tend to overlook how individual, expression-related, and contextual factors shape recognition outcomes. This study addresses these limitations through a preferred reporting items for systematic reviews and meta-analyses (PRISMA)-based systematic review of ME recognition research published between 2015 and 2025, covering preprocessing methods, feature representation, and dataset characteristics. The review critically compares existing approaches, weighing their strengths, limitations, and suitability for real-world deployment. It examines persistent challenges, including dataset imbalance, limited cross-dataset generalization, and underexplored temporal dynamics, alongside emerging directions in action unit-based, multimodal, and deep learning methods. Specific recommendations for future work aimed at closing the gap between laboratory findings and practical application are also provided. By grounding the analysis in transparent selection criteria and structured synthesis, this work offers a reproducible foundation for advancing ME recognition research.
微表情识别、分类和数据集综述
面部微表情(MEs)是一种短暂的、不自觉的面部动作,它揭示了一个人试图压抑或隐藏的真实情绪。它们持续时间短、强度低,对人类观察者和自动识别系统构成了相当大的挑战,但微神经在心理治疗、欺骗检测、市场营销和公共安全方面具有实用价值。一些调查已经回顾了ME的认识,但大多数主要是描述性的,缺乏文献选择和分析的系统框架。他们也倾向于忽视个体、表情相关和语境因素如何影响识别结果。本研究通过对2015年至2025年间发表的ME识别研究进行系统综述和meta分析(PRISMA)的优选报告项目,涵盖预处理方法、特征表示和数据集特征,解决了这些局限性。这篇综述对现有的方法进行了批判性的比较,权衡了它们的优势、局限性和对实际部署的适用性。它探讨了持续存在的挑战,包括数据集不平衡、有限的跨数据集泛化、未充分开发的时间动态,以及基于行动单元、多模态和深度学习方法的新兴方向。还提供了旨在缩小实验室发现与实际应用之间差距的未来工作的具体建议。通过基于透明选择标准和结构化合成的分析,本工作为推进ME识别研究提供了可重复的基础。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Computational Social Systems
IEEE Transactions on Computational Social Systems Social Sciences-Social Sciences (miscellaneous)
CiteScore
10.00
自引率
20.00%
发文量
316
期刊介绍: IEEE Transactions on Computational Social Systems focuses on such topics as modeling, simulation, analysis and understanding of social systems from the quantitative and/or computational perspective. "Systems" include man-man, man-machine and machine-machine organizations and adversarial situations as well as social media structures and their dynamics. More specifically, the proposed transactions publishes articles on modeling the dynamics of social systems, methodologies for incorporating and representing socio-cultural and behavioral aspects in computational modeling, analysis of social system behavior and structure, and paradigms for social systems modeling and simulation. The journal also features articles on social network dynamics, social intelligence and cognition, social systems design and architectures, socio-cultural modeling and representation, and computational behavior modeling, and their applications.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书