Coarse-To-Fine Segmentation Refinement and Missing Shape Recovery for Halibut Fish

Abstract

Image processing and analysis techniques have drawn increasing attention since they enable a non-extractive and non-lethal approach to fisheries survey. To measure the fish size and length accurately, a reliable segmentation result is required. However, there are two major challenges about the segmentation. One is that images may be blurred due to the spray of water on the camera lens, and the other is that some part of the fish body is out of the camera view. In this paper, we present an innovative and effective contour-based segmentation refinement and missing shape recovery method from an arbitrary initial segmentation. The refinement is processed from coarse level to fine level. At the coarse level, a weighted affine transform is estimated to align the entire fish contour of the initial segmentation with trained representative contours. At the finer and finest levels, we iteratively refine the contour segments to represent the poorly segmented or shape missing image. The proposed method shows promising results on segmentation and length measurement for both water drop images and images with part of the fish out of the camera view.