Deep Learning Approach for Complex Activity Recognition using Heterogeneous Sensors from Wearable Device

Abstract

The classification of simple and complex sequences of operations is made easier according to the use of heterogeneous sensors from a wearable device. Sensor-based human activity recognition (HAR) is being used in smartphone platforms for elderly healthcare monitoring, fall detection, and inappropriate behavior prevention, such as smoking habit, unhealthy eating, and lack of exercise. Common machine learning and deep learning techniques have recently been presented to tackle the HAR issue, with a focus on everyday activities, particularly general human activities including moving, sitting, and standing. However, there is an intriguing and challenging HAR research subjects involving more complicated psychological activities in various environments, including smoking, eating, and drinking. The use of heterogeneous sensor data to enhance recognition performance over sensor-based deep learning networks is considered in this work. We demonstrate that using a combination of two inertial measurement units outperforms employing either an accelerometer or a gyroscope by utilizing four deep learning classifiers to recognize complex human activity (CHA). Furthermore, we describe the impact of five window sizes (5s - 40s) on a publicly accessible benchmark dataset and how increasing window size effects to the classification performance of CHA deep learning networks.