Emotion recognition from facial expression using general type-2 fuzzy set

Abstract

Facial expression of a person representative of similar emotions is not always unique. Naturally, the facial features of a subject taken from different instances of the same emotion have wider variations. In presence of two or more facial features, the variation of the attributes together makes the emotion recognition problem more complicated. This variation is the main source of uncertainty in the emotion recognition problem, which has been addressed here in two steps using type-2 fuzzy sets. First a type-2 fuzzy face-space is constructed with the background knowledge of facial features of different subjects for different emotions. Second, the emotion of an unknown facial expression is determined based on the consensus of the measured facial features with the fuzzy face-space. General Type-2 Fuzzy Sets have been used to model the fuzzy face space. The general type-2 fuzzy set involves both primary and secondary membership distributions, which have been obtained here by formulating and solving an optimization problem. The optimization problem here attempts to minimize the difference between two decoded signals: the first one being the type-1 defuzzification of the average primary membership distributions obtained from the n-subjects, while the second one refers to the type-2 defuzzified signal for a given primary distribution with secondary memberships as unknown. The uncertainty management policy adopted using general type-2 fuzzy set has resulted in a classification accuracy of 96.67%.