A novel deep learning framework for detecting seafarer’s unsafe behavior

Abstract The accurate detection of seafarers’ unsafe behaviors is of great significance to improve the ship navigation safety. This study proposes an improved deep learning framework with a self-made dataset to detect the unsafe behavior of seafarers on duty. In order to increase the detection speed, the improved Cross Stage Partial connections (CSP) module is proposed to replace the original CSP module in the neck network of traditional algorithm. The efficient channel attention (ECA) module is also introduced to the backbone network of conventional algorithm as the attention mechanism network. In addition, the learning and representation capacities of the improved deep learning framework are promoted by redesigning the sizes of anchor boxes. The experiment results show that the proposed framework outperforms traditional object detection algorithms (e.g., YOLOv5s, R-CNN) in detecting seafarers’ unsafe behaviors because of the much higher detection speed and detection accuracy.