Concrete crack segmentation based on convolution–deconvolution feature fusion with holistically nested networks

Abstract

Automatic crack detection on concrete surfaces has become increasingly important for the health diagnosis of concrete structures to prevent possible malfunctions or accidents. In this paper, a concrete crack segmentation network based on convolution–deconvolution feature fusion with holistically nested networks is proposed. The proposed network adopts an encoder–decoder structure and uses VGG‐16 as the basic feature extraction network. First, considering the problem that the VGG‐16 network can extract redundant features in the encoding stage, based on the channel attention mechanism, the channel spatial correlation and global information are used to emphasize crack features to remove redundant features. Second, through the convolution–deconvolution feature fusion module, the deep semantic information of the deconvolution is effectively fused with the shallow features of convolution, which effectively improves the semantic crack feature information extracted at each stage of the VGG‐16 network. Finally, based on a multiscale supervised learning mechanism, holistically nested networks are used to fuse the prediction results from different scales, which enhances the network's ability to express linear topological structures and improves the accuracy of crack segmentation. Through a large number of experiments on the Bridge_Crack_Image_Data dataset and CFD dataset, we demonstrate that compared with other deep networks, the proposed network not only achieves better segmentation results for cracks of different widths but is also more robust.