{"title":"Real-time face blending by automatic facial feature point detection","authors":"M. Yuasa, Osamu Yamaguchi","doi":"10.1109/AFGR.2008.4813441","DOIUrl":"https://doi.org/10.1109/AFGR.2008.4813441","url":null,"abstract":"In this demonstration, we present a real-time “face blending” method based on an automatic detection of facial feature points. The method can blend faces of two people and generate a morphing-like synthetic image. The system is composed of a PC and a web camera. It is able to create a natural blended image from an image from the web camera in real-time. First, fourteen types of facial feature points are detected automatically in both base and texture images. Then the correspondences of the feature points and those of a 3D generic facial shape model are calculated for both images. An intermediate image whose corresponding coordinates for the model are known is generated from the texture image. Finally the blended image is rendered using the generated intermediate image and the base image.","PeriodicalId":213883,"journal":{"name":"2008 8th IEEE International Conference on Automatic Face & Gesture Recognition","volume":"26 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129370684","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
M. Wimmer, S. Fujie, F. Stulp, Tetsunori Kobayashi, B. Radig
{"title":"An ASM fitting method based on machine learning that provides a robust parameter initialization for AAM fitting","authors":"M. Wimmer, S. Fujie, F. Stulp, Tetsunori Kobayashi, B. Radig","doi":"10.1109/AFGR.2008.4813465","DOIUrl":"https://doi.org/10.1109/AFGR.2008.4813465","url":null,"abstract":"Due to their use of information contained in texture, active appearance models (AAM) generally outperform active shape models (ASM) in terms of fitting accuracy. Although many extensions and improvements over the original AAM have been proposed, on of the main drawbacks of AAMs remains its dependence on good initial model parameters to achieve accurate fitting results. In this paper, we determine the initial model parameters for AAM fitting with ASM fitting, and use machine learning techniques to improve the scope and accuracy of ASM fitting. Combining the precision of AAM fitting with the large radius of convergence of learned ASM fitting improves the results by an order of magnitude, as our empirical evaluation on a database of publicly available benchmark images demonstrates.","PeriodicalId":213883,"journal":{"name":"2008 8th IEEE International Conference on Automatic Face & Gesture Recognition","volume":"73 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116251709","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Model-based reconstruction for illumination variation in face images","authors":"B. Boom, L. Spreeuwers, R. Veldhuis","doi":"10.1109/AFGR.2008.4813364","DOIUrl":"https://doi.org/10.1109/AFGR.2008.4813364","url":null,"abstract":"We propose a novel method to correct for arbitrary illumination variation in the face images. The main purpose is to improve recognition results of face images taken under uncontrolled illumination conditions. We correct the illumination variation in the face images using a face shape model, which allows us to estimate the face shape in the face image. Using this face shape, we can reconstruct a face image under frontal illumination. These reconstructed images improve the results in face identification. We experimented both with face images acquired under different controlled illumination conditions in a laboratory and under uncontrolled illumination conditions.","PeriodicalId":213883,"journal":{"name":"2008 8th IEEE International Conference on Automatic Face & Gesture Recognition","volume":"4 2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116675417","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Discriminative human action recognition using pairwise CSP classifiers","authors":"R. Poppe, M. Poel","doi":"10.1109/AFGR.2008.4813447","DOIUrl":"https://doi.org/10.1109/AFGR.2008.4813447","url":null,"abstract":"We present a discriminative approach to human action recognition. At the heart of our approach is the use of common spatial patterns (CSP), a spatial filter technique that transforms temporal feature data by using differences in variance between two classes. Such a transformation focusses on differences between classes, rather than on modelling each class individually. As a results, to distinguish between two classes, we can use simple distance metrics in the low-dimensional transformed space. The most likely class is found by pairwise evaluation of all discriminant functions. Our image representations are silhouette boundary gradients, spatially binned into cells. We achieve scores of approximately 96% on a standard action dataset, and show that reasonable results can be obtained when training on only a single subject. Future work is aimed at combining our approach with automatic human detection.","PeriodicalId":213883,"journal":{"name":"2008 8th IEEE International Conference on Automatic Face & Gesture Recognition","volume":"36 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130662578","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Meeting behavior detection in smart environments: Nonverbal cues that help to obtain natural interaction","authors":"M. Poel, R. Poppe, A. Nijholt","doi":"10.1109/AFGR.2008.4813432","DOIUrl":"https://doi.org/10.1109/AFGR.2008.4813432","url":null,"abstract":"Unobtrusive and multiple-sensor interfaces enable observation of natural human behavior in smart environments. Being able to detect, analyze and interpret this activity allows for the implementation of various applications, including real-time surveillance and real-time support in smart home and office environments. We focus on smart meeting environments, where nonverbal behavioral cues sometimes tell more about issues such as discussion participation, involvement and contribution, than information obtained from verbal contributions. An important aspect of this behavior is the interaction between meeting participants. We regard the special case where some of the participants are at physically different locations, which hinders natural interaction. We discuss how we can exploit the ability of a sensor-equipped environment to detect nonverbal interaction cues and use these to allow and improve natural interaction between collaborating participants at distributed locations. We focus on research efforts to detect nonverbal interaction cues by looking at various modalities. Also, we discuss how information obtained from the fusion of these modalities allows us to generate and display behavioral cues that allow remote participants to take part in a distributed meeting in a natural way.","PeriodicalId":213883,"journal":{"name":"2008 8th IEEE International Conference on Automatic Face & Gesture Recognition","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114877665","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Tracking facial features under occlusions and recognizing facial expressions in sign language","authors":"T. Nguyen, S. Ranganath","doi":"10.1109/AFGR.2008.4813464","DOIUrl":"https://doi.org/10.1109/AFGR.2008.4813464","url":null,"abstract":"This paper presents work towards recognizing facial expressions that are used in sign language recognition. Facial features are tracked to effectively capture temporal visual cues on the signer's face during signing. A Bayesian framework is proposed as a feedback mechanism to the Kanade-Lucas-Tomasi (KLT) tracker for reliably tracking facial features in the presence of head motions and temporary occlusions by hand. This mechanism relies on a set of face shape subspaces learned by probabilistic principal component analysis with an update scheme to adapt to persons with different face shapes. The results show that the proposed tracker can track facial features with large head motions, substantial facial deformations, and temporary facial occlusions by hand. The tracked results were input to a recognition system comprising HMMs and a NN to recognize four common American sign language facial expressions.","PeriodicalId":213883,"journal":{"name":"2008 8th IEEE International Conference on Automatic Face & Gesture Recognition","volume":"53 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120998320","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Orozco, Ognjen Rudovic, F. X. Roca, Jordi Gonzàlez
{"title":"Confidence assessment on eyelid and eyebrow expression recognition","authors":"J. Orozco, Ognjen Rudovic, F. X. Roca, Jordi Gonzàlez","doi":"10.1109/AFGR.2008.4813454","DOIUrl":"https://doi.org/10.1109/AFGR.2008.4813454","url":null,"abstract":"In this paper, we address the recognition of subtle facial expressions by reasoning on the classification confidence. Psychological evidences have determined that eyelids and eyebrows are significant for the recognition of subtle facial expressions and the early perception of human emotions. This early perception results in a more complex problem, which requires a confidence assessment for any provided solution. Thus, traditional score-based classifiers (e.g. k-NN and NN) are not able to produce confident estimates. Instead, we first present five confidence estimators and a confidence classification assessment for Case-Based Reasoning (CBR). Second, we improve the expression retrieval from the database by learning the neighbourhood's dimensions for the expected classification confidences. Third, we reuse the previous classified expressions and the confidence assessment to improve the classification achieved by k-NN. Fourth, we improve the database for generalization with new subjects by learning thresholds to minimize misclassification with low confidence, maximize correct classifications with high confidence and re-arrange misclassification with high confidence. The proposed system represents an effective contribution for both subtle expression recognition and CBR methodology. It achieves an average recognition of 97% plusmn 1% with a confidence of 96% plusmn 2% for expressiveness between 20% and 100%.","PeriodicalId":213883,"journal":{"name":"2008 8th IEEE International Conference on Automatic Face & Gesture Recognition","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121264183","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Activity detection in conversational sign language video for mobile telecommunication","authors":"Neva Cherniavsky, R. Ladner, E. Riskin","doi":"10.1109/AFGR.2008.4813363","DOIUrl":"https://doi.org/10.1109/AFGR.2008.4813363","url":null,"abstract":"The goal of the MobileASL project is to increase accessibility by making the mobile telecommunications network available to the signing Deaf community. Video cell phones enable Deaf users to communicate in their native language, American Sign Language (ASL). However, encoding and transmission of real-time video over cell phones is a power-intensive task that can quickly drain the battery.","PeriodicalId":213883,"journal":{"name":"2008 8th IEEE International Conference on Automatic Face & Gesture Recognition","volume":"213 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123335707","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The significance of facial features for automatic sign language recognition","authors":"Ulrich von Agris, Moritz Knorr, K. Kraiss","doi":"10.1109/AFGR.2008.4813472","DOIUrl":"https://doi.org/10.1109/AFGR.2008.4813472","url":null,"abstract":"Although facial features are considered to be essential for humans to understand sign language, no prior research work has yet examined their significance for automatic sign language recognition or presented some evaluation results. This paper describes a vision-based recognition system that employs both manual and facial features, extracted from the same input image. For facial feature extraction an active appearance model is applied to identify areas of interest such as the eyes and mouth region. Afterwards a numerical description of facial expression and lip outline is computed. An extensive evaluation was performed on a new sign language corpus, which contains continuous articulations of 25 native signers. The obtained results proved the importance of integrating facial expressions into the classification process. The recognition rates for isolated and continuous signing increased in signer-dependent as well as in signer-independent operation mode. Interestingly, roughly two of ten signs were recognized just from the facial features.","PeriodicalId":213883,"journal":{"name":"2008 8th IEEE International Conference on Automatic Face & Gesture Recognition","volume":"37 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123715816","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Towards more accurate 3D face registration under the guidance of prior anatomical knowledge on human faces","authors":"X. Tang, Jiansheng Chen, Y. Moon","doi":"10.1109/AFGR.2008.4813311","DOIUrl":"https://doi.org/10.1109/AFGR.2008.4813311","url":null,"abstract":"Three-dimensional face registration is a critical step in 3D face recognition. A fully automatic registration method for aligning frontal 3D face data is presented in this paper with high accuracy and robustness to facial expressions. In our method, the nose region, which is relatively more rigid than other facial regions in Anatomy sense, is automatically located and analyzed for computing the precise location of a symmetry plane. We then proceed on to find a stable reference point and a nose line from the global information of the nose region. In this way, the six degrees of freedom as well as a unified coordinate system can be determined for each face. Extensive experiments have been conducted on the FRGC V1.0 benchmark face dataset to evaluate the accuracy and robustness of our registration method. Firstly, we compare its results with two other registration methods. One of such methods employs manually marked points on visualized face data and the other is based on the use of a symmetry plane analysis obtained from the whole face region. Secondly, we test its application in a 3-D face verification system. Preliminary experiment results show that this approach can efficiently reduce the intra-class distance and performs better than the other two registration methods in face recognition.","PeriodicalId":213883,"journal":{"name":"2008 8th IEEE International Conference on Automatic Face & Gesture Recognition","volume":"55 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2008-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123801297","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}