A method for detecting gaze-required action while cooking for assisting video communication

Abstract

In this paper, under the situation that a teacher teaches a student how to cook via bi-directional video communication system, we propose a method to detect whether the student can watch the display and listen to the teacher's instruction without interrupting his/her cooking. Firstly, we investigates the properties of taking the gaze on/off during cooking action, and secondly we proposed methods to automatically detect gaze-required cooking actions on the captured cooking video.