Multi-sensor fusion based optimized deep convolutional neural network for boxing punch activity recognition

Abstract

Recent advancements in deep learning have significantly enhanced the recognition of player activities in sports by enabling automatic feature extraction. In our proposed work, we focus on recognizing six distinct punches in the context of boxing. We incorporate the sliding window technique during the pre-processing stage to transform the time-series data obtained from Inertial Measurement Unit (IMU) sensors in a boxing punch activity recognition system. Our approach influences a sensor fusion-based Deep Convolutional Neural Network (DCNN) classification model to identify various boxing punches accurately, achieving an impressive F1 score. The system demonstrates proficiency in distinguishing similar activities, such as jab and hook punches where the existing systems made misclassifications due to subtle variations in arm flexion that differentiate the two. Through experimentation, we identify an optimal window size for boxing punch activity recognition, which falls within the range of 15–20 frames (equivalent to 0.15–0.25 s). This window size selection results in a notable reduction in inference time. To evaluate our proposed model, we conduct comparisons with a standard DCNN and an optimized DCNN model. Our proposed optimized DCNN model demonstrates enhanced recognition accuracy, achieving an impressive 99%, coupled with an improved F1 score of 87%. Furthermore, the model displays a remarkable reduction in inference time, clocking in at less than 1 ms. Overall, our research contributes to the field of sports-related player activity recognition by employing the power of deep learning. By expertly combining these techniques, we achieve remarkable accuracy, precision, and efficiency in recognizing various boxing punches.