CNN-CCA: A deep learning approach for anomaly detection in metro rail sensor time-series data

Abstract

The Internet of Things (IoT) offers new challenges in estimating correlations among data from multiple connected devices to understand their behaviors. Canonical Correlation Analysis (CCA) can be used to measure correlations among several observed variables. Different CCA methods have been proposed in the literature including probabilistic, sparse, kernel, discriminative, and deep learning-based CCAs. However, existing CCA approaches are limited by assumptions of linearity, reliance on predefined kernels, or difficulty in modeling localized patterns in high-frequency IoT sensor data. In this research, we explore two methods, linear CCA and non-linear deep learning-based CCA. Experiments demonstrate the effectiveness of CCA in detecting correlation in synthetic and metro rail time series sensor data collected from Autonomous Train (AT) signaling systems. Also, we propose a novel Convolutional Neural Network (CNN) based CCA method to detect correlation-based mappings and combine it with statistical anomaly detection methods in collective anomaly detection. The results indicate strong performance with an F1-score of 89.0% and a sensitivity of 94.1%, which can pave the way for the application of the proposed models to real-time collective anomaly detection and CCA in IoT systems.