{"title":"DisVAE:高质量面部表情特征的解纠缠变分自编码器","authors":"Tianhao Wang, Mingyue Zhang, Lin Shang","doi":"10.1109/FG57933.2023.10042668","DOIUrl":null,"url":null,"abstract":"Facial expression feature extraction suffers from high inter-subject variations caused by identity-related personal attributes. The extracted expression features are consistently entangled with other identity-related features, which has an influence on related facial expression tasks such as recognition and editing. To achieve high-quality expression features, a Disentangled Variational Autoencoder (DisVAE) is proposed to disentangle expression and identity features. The identity features are removed from the facial features via facial image reconstruction firstly, and then the remaining features represent expression components. Extensive experiments on three public datasets have shown that the proposed DisVAE can effectively disentangle expression and identity features, and extract expression features without the interfere of identity attributes. The high-quality expression features improve the performance of facial expression recognition and can be well applied to facial expression editing.","PeriodicalId":318766,"journal":{"name":"2023 IEEE 17th International Conference on Automatic Face and Gesture Recognition (FG)","volume":"8 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-01-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DisVAE: Disentangled Variational Autoencoder for High-Quality Facial Expression Features\",\"authors\":\"Tianhao Wang, Mingyue Zhang, Lin Shang\",\"doi\":\"10.1109/FG57933.2023.10042668\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Facial expression feature extraction suffers from high inter-subject variations caused by identity-related personal attributes. The extracted expression features are consistently entangled with other identity-related features, which has an influence on related facial expression tasks such as recognition and editing. To achieve high-quality expression features, a Disentangled Variational Autoencoder (DisVAE) is proposed to disentangle expression and identity features. The identity features are removed from the facial features via facial image reconstruction firstly, and then the remaining features represent expression components. Extensive experiments on three public datasets have shown that the proposed DisVAE can effectively disentangle expression and identity features, and extract expression features without the interfere of identity attributes. The high-quality expression features improve the performance of facial expression recognition and can be well applied to facial expression editing.\",\"PeriodicalId\":318766,\"journal\":{\"name\":\"2023 IEEE 17th International Conference on Automatic Face and Gesture Recognition (FG)\",\"volume\":\"8 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-01-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 IEEE 17th International Conference on Automatic Face and Gesture Recognition (FG)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/FG57933.2023.10042668\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE 17th International Conference on Automatic Face and Gesture Recognition (FG)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/FG57933.2023.10042668","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
DisVAE: Disentangled Variational Autoencoder for High-Quality Facial Expression Features
Facial expression feature extraction suffers from high inter-subject variations caused by identity-related personal attributes. The extracted expression features are consistently entangled with other identity-related features, which has an influence on related facial expression tasks such as recognition and editing. To achieve high-quality expression features, a Disentangled Variational Autoencoder (DisVAE) is proposed to disentangle expression and identity features. The identity features are removed from the facial features via facial image reconstruction firstly, and then the remaining features represent expression components. Extensive experiments on three public datasets have shown that the proposed DisVAE can effectively disentangle expression and identity features, and extract expression features without the interfere of identity attributes. The high-quality expression features improve the performance of facial expression recognition and can be well applied to facial expression editing.