{"title":"基于时空Gabor滤波器的微表情识别","authors":"ChenHan Lin, Fei Long, J. Huang, Jun Li","doi":"10.1109/ICIST.2018.8426088","DOIUrl":null,"url":null,"abstract":"For its wide range of applications in public security and psychotherapy, recognizing micro-expressions from facial image sequences has gain increasing attentions recently. Subtlety and short duration are major challenges for micro-expression recognition. In this paper, we propose a method for micro-expression recognition based on spatiotemporal Gabor filters. In preprocessing, for each video clip, the intensities of facial movements are first magnified by Eulerian video magnification (EVM), and then a sequence of frame difference is generated by subtracting a non-expression frame from all the frames in original video clip. Following that, we convolve a bank of spatiotemporal Gabor filters with the difference sequences, and the magnitudes of Gabor filter responses are used as features. The final features are fed up into a linear SVM for classification after spatiotemporal max pooling. The proposed method is evaluated on two micro-expression datasets, CASME2 and SMIC. Experimental results on CASME2 demonstrate the importance of preprocessing for micro-expression recognition. Furthermore, the proposed method achieves better recognition performance than some popular methods on both CASME2 and SMIC datasets, such as LBP-TOP and HOOF, in micro-expression recognition.","PeriodicalId":331555,"journal":{"name":"2018 Eighth International Conference on Information Science and Technology (ICIST)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2018-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"Micro-Expression Recognition Based on Spatiotemporal Gabor Filters\",\"authors\":\"ChenHan Lin, Fei Long, J. Huang, Jun Li\",\"doi\":\"10.1109/ICIST.2018.8426088\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"For its wide range of applications in public security and psychotherapy, recognizing micro-expressions from facial image sequences has gain increasing attentions recently. Subtlety and short duration are major challenges for micro-expression recognition. In this paper, we propose a method for micro-expression recognition based on spatiotemporal Gabor filters. In preprocessing, for each video clip, the intensities of facial movements are first magnified by Eulerian video magnification (EVM), and then a sequence of frame difference is generated by subtracting a non-expression frame from all the frames in original video clip. Following that, we convolve a bank of spatiotemporal Gabor filters with the difference sequences, and the magnitudes of Gabor filter responses are used as features. The final features are fed up into a linear SVM for classification after spatiotemporal max pooling. The proposed method is evaluated on two micro-expression datasets, CASME2 and SMIC. Experimental results on CASME2 demonstrate the importance of preprocessing for micro-expression recognition. Furthermore, the proposed method achieves better recognition performance than some popular methods on both CASME2 and SMIC datasets, such as LBP-TOP and HOOF, in micro-expression recognition.\",\"PeriodicalId\":331555,\"journal\":{\"name\":\"2018 Eighth International Conference on Information Science and Technology (ICIST)\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2018 Eighth International Conference on Information Science and Technology (ICIST)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICIST.2018.8426088\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 Eighth International Conference on Information Science and Technology (ICIST)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICIST.2018.8426088","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4
摘要
基于人脸图像序列的微表情识别由于在公安、心理治疗等领域的广泛应用,近年来越来越受到人们的关注。微表情识别的难点在于微表情的微妙性和持续时间短。本文提出了一种基于时空Gabor滤波器的微表情识别方法。在预处理过程中,首先对每个视频片段进行欧拉视频放大(Eulerian video magnification, EVM),然后在原始视频片段的所有帧中减去一个无表情帧,生成一个帧差序列。然后,我们将一组时空Gabor滤波器与差分序列进行卷积,并将Gabor滤波器响应的幅度作为特征。经过时空最大池化后,将最终特征输入线性支持向量机进行分类。在CASME2和SMIC两个微表情数据集上对该方法进行了评价。CASME2的实验结果证明了预处理对微表情识别的重要性。此外,在微表情识别方面,该方法在CASME2和SMIC数据集上的识别性能均优于现有的LBP-TOP和HOOF方法。
Micro-Expression Recognition Based on Spatiotemporal Gabor Filters
For its wide range of applications in public security and psychotherapy, recognizing micro-expressions from facial image sequences has gain increasing attentions recently. Subtlety and short duration are major challenges for micro-expression recognition. In this paper, we propose a method for micro-expression recognition based on spatiotemporal Gabor filters. In preprocessing, for each video clip, the intensities of facial movements are first magnified by Eulerian video magnification (EVM), and then a sequence of frame difference is generated by subtracting a non-expression frame from all the frames in original video clip. Following that, we convolve a bank of spatiotemporal Gabor filters with the difference sequences, and the magnitudes of Gabor filter responses are used as features. The final features are fed up into a linear SVM for classification after spatiotemporal max pooling. The proposed method is evaluated on two micro-expression datasets, CASME2 and SMIC. Experimental results on CASME2 demonstrate the importance of preprocessing for micro-expression recognition. Furthermore, the proposed method achieves better recognition performance than some popular methods on both CASME2 and SMIC datasets, such as LBP-TOP and HOOF, in micro-expression recognition.