Mouth covered detection for yawn

Abstract

Yawn is one of the common fatigue sign phenomena. The common technique to detect yawn is based upon the measurement of mouth opening. However, the spontaneous human action to cover the mouth during yawn can prevent such measurements. This paper presents a new technique to detect the covered mouth by employing the Local Binary Pattern (LBP) features. Subsequently, the facial distortions during the yawn process are identified by measuring the changes of wrinkles using Sobel edges detector. In this research the Strathclyde Facial Fatigue (SFF) database that contains genuine fatigue signs is used for training, testing and evaluation of the developed algorithms. This database was created from sleep deprivation experiments that involved twenty participants.