Object Modeling From Underwater Forward-Scan Sonar Imagery With Sea-Surface Multipath

Abstract

In this article, we propose an optimization technique for 3-D underwater object modeling from 2-D forward-scan sonar images at known poses. A key contribution, for objects imaged in the proximity of the sea surface, is to resolve the multipath artifacts due to the air–water interface. Here, the object image formed by the direct target backscatter is almost always corrupted by the ghost and sometimes by the mirror components (generated by the multipath propagation). Assuming a planar air–water interface, we model, localize, and discard the corrupted object region within each view, thus avoiding the distortion of recovered 3-D shape. In addition, complementary visual cues from the boundary of the mirror component, distinct at suitable sonar poses, are employed to enhance the 3-D modeling accuracy. Optimization is implemented as iterative shape adjustment by displacing the vertices of triangular patches in the 3-D surface mesh model, to minimize the discrepancy between the data and synthesized views of the 3-D object model. To this end, we first determine 2-D motion fields that align the object regions in the data and synthesized views, then calculate the 3-D motion of triangular patch centers, and finally determine the model vertices. The 3-D model is initialized with the solution of an earlier space-carving method applied to the same data. The same parameters are applied in various experiments with two real data sets, a mixed real-synthetic data set, and computer-generated data guided by general findings from a real experiment, to explore the impact of nonflat air–water interface. The results confirm the generation of a refined 3-D model in about half-dozen iterations.