Cooking procedure recognition and inference in sensor embedded kitchen

Abstract

This paper proposes cooking support using ubiquitous sensors. We developed a machine learning algorithm that recognizes cooking procedures by taking into account widely varying sensor information and user behavior. To provide appropriate instructions to users, we developed a Markov-model-based behavior prediction algorithm. Using these algorithms, we developed cooking support automatically displaying cooking instruction videos based on user progress. Experiments and experimental results confirmed the feasibility of our proposed cooking support.