KissLoc: A Spatio-temporal Kissing Recognition System Using Commercial Smart Glasses

Abstract

In this paper, we propose KissLoc: a system that leverages onboard micro-size sensors of consumer eyewear devices for the dual purpose of activity recognition and localization. Specifically, the system trains a deep learning model for recognizing kissing activity and simultaneously identifying the timestamped location of its occurrence. Consequently, several predefined actions could be taken, including logging or controlling the smart environment. The evaluation shows that KissLoc can recognize the kissing activity with 82% accuracy while locating its occurrence with a median localization error of 1.25m.