{"title":"Object Modeling From Underwater Forward-Scan Sonar Imagery With Sea-Surface Multipath","authors":"Yuhan Liu;Shahriar Negahdaripour","doi":"10.1109/JOE.2024.3412268","DOIUrl":"https://doi.org/10.1109/JOE.2024.3412268","url":null,"abstract":"In this article, we propose an optimization technique for 3-D underwater object modeling from 2-D forward-scan sonar images at known poses. A key contribution, for objects imaged in the proximity of the sea surface, is to resolve the multipath artifacts due to the air–water interface. Here, the object image formed by the direct target backscatter is almost always corrupted by the ghost and sometimes by the mirror components (generated by the multipath propagation). Assuming a planar air–water interface, we model, localize, and discard the corrupted object region within each view, thus avoiding the distortion of recovered 3-D shape. In addition, complementary visual cues from the boundary of the mirror component, distinct at suitable sonar poses, are employed to enhance the 3-D modeling accuracy. Optimization is implemented as iterative shape adjustment by displacing the vertices of triangular patches in the 3-D surface mesh model, to minimize the discrepancy between the data and synthesized views of the 3-D object model. To this end, we first determine 2-D motion fields that align the object regions in the data and synthesized views, then calculate the 3-D motion of triangular patch centers, and finally determine the model vertices. The 3-D model is initialized with the solution of an earlier space-carving method applied to the same data. The same parameters are applied in various experiments with two real data sets, a mixed real-synthetic data set, and computer-generated data guided by general findings from a real experiment, to explore the impact of nonflat air–water interface. The results confirm the generation of a refined 3-D model in about half-dozen iterations.","PeriodicalId":13191,"journal":{"name":"IEEE Journal of Oceanic Engineering","volume":"50 1","pages":"324-337"},"PeriodicalIF":3.8,"publicationDate":"2024-10-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142992915","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jens Einar Bremnes;Ingrid Bouwer Utne;Thomas Røbekk Krogstad;Asgeir Johan Sørensen
{"title":"Holistic Risk Modeling and Path Planning for Marine Robotics","authors":"Jens Einar Bremnes;Ingrid Bouwer Utne;Thomas Røbekk Krogstad;Asgeir Johan Sørensen","doi":"10.1109/JOE.2024.3432935","DOIUrl":"https://doi.org/10.1109/JOE.2024.3432935","url":null,"abstract":"Risk awareness and assessment are fundamental aspects of human cognition and situational awareness, and play crucial roles in problem solving and decision-making. In this article, we present a novel methodology for integrated risk modeling and path planning in robotics mimicking these human processes. This approach creates a holistic geospatial data structure of risk, showing what may go wrong, where and when it is more likely, and the potential causes and consequences; all of which may be used as input to planning and decision-making algorithms for improved robotic autonomy. First, a hazard analysis of the operation is performed, with the objective of analyzing possible hazardous events, their causal factors, and potential consequences. This knowledge is then incorporated into a Bayesian belief network for estimating the risk at a particular point in space and time. Two methods for path planning taking these results as input are proposed: first, the risk-based path planner, and second, the risk-based traveling salesperson, both of which can balance the tradeoffs between risk and reward related to the mission objectives. We demonstrate the novel methodology with a real case study: seabed survey of the Tautra coral reef in Norway using an autonomous underwater vehicle (AUV), capitalizing on data from previous field operations. The case study shows that the AUV adapts its mission based on the perceived and assessed risk. By combining methods from robotics, artificial intelligence, risk science, and geoinformatics this work provides an interdisciplinary and novel contribution to enhanced robotic autonomy.","PeriodicalId":13191,"journal":{"name":"IEEE Journal of Oceanic Engineering","volume":"50 1","pages":"252-275"},"PeriodicalIF":3.8,"publicationDate":"2024-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142992997","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Novel Tracker of Adaptive Directional Ridge Separation and Prediction for Detecting Whistles","authors":"Yongchun Miao;Jianghui Li;Yingsong Li","doi":"10.1109/JOE.2024.3403255","DOIUrl":"https://doi.org/10.1109/JOE.2024.3403255","url":null,"abstract":"Whistle detection of marine mammal signals with close and overlapping components of varying amplitudes is a key task for overlapping source separation. In this article, we propose a novel tracker, called adaptive directional ridge separation and prediction, for detecting whistles, which are typically analyzed using a time-frequency (TF) representation. Inspired by TF reassignment, a new reassignment scheme based on time-scale changes is developed to acquire instantaneous TF points with high energy concentration. To address the mutual interference among various types of components, a tone-pulse separation model is introduced for the aliased TF components, utilizing these instantaneous TF points and instantaneous rotating operators. An adaptive directional ridge predictor is established for application in automatic overlapping whistle detection, ensuring unbroken detection even when a whistle becomes nearly indistinguishable in the TF representation. Experimental results, obtained using both a simulated signal and recorded calls of marine mammals, demonstrate the superiority of the proposed method compared to other state-of-the-art methods. This method is capable of performing whistle detection and separating overlapping sources even in the presence of splash noises, which may cause partial distortion or disconnection of components from the TF representation.","PeriodicalId":13191,"journal":{"name":"IEEE Journal of Oceanic Engineering","volume":"50 1","pages":"13-24"},"PeriodicalIF":3.8,"publicationDate":"2024-10-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142992989","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Hierarchical Interactive Attention Res-UNet for Inland Water Monitoring With Satellite-Based SAR Imagery","authors":"Yemao Yang;Weiliang Tao;Yan Liu;Lei Cheng;Yuan Gao","doi":"10.1109/JOE.2024.3447782","DOIUrl":"https://doi.org/10.1109/JOE.2024.3447782","url":null,"abstract":"The extraction and change detection of river-lake boundaries has a wide range of applications. Especially in flood monitoring, river-lake boundary monitoring systems can provide important information support for relevant departments in flood prevention and relief. Aiming at the problem that the existing research has low accuracy and poor boundary quality in complex terrain, we propose a hierarchical interactive attention Res-UNet. By introducing a cross-dimensional attention mechanism with hierarchical interactions, the model's ability to perceive key features is improved. In addition, we propose contour-aware mixed loss, which pays more attention to difficult samples and edge pixels. Based on Sentinel-1A satellite data, we produce a synthetic aperture radar data set of river and lake water bodies. Through comparative experiments, the effectiveness of this method in improving water body segmentation accuracy and boundary quality is proved. The final F1 score is 0.973 and HD95: Hausdorff distance (HD) with a 95% confidence level is 2.219. Finally, we apply our methodology to study the changes in the water body near Wuhan Sancha Harbor during the 2020 Yangtze River flood, which proves the effectiveness of the scheme.","PeriodicalId":13191,"journal":{"name":"IEEE Journal of Oceanic Engineering","volume":"49 4","pages":"1265-1274"},"PeriodicalIF":3.8,"publicationDate":"2024-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142438508","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"NWSP: A Novel Indicator for Ocean–Land Interface Extraction Using Bathymetric LiDAR","authors":"Xinglei Zhao;Hui Xia;Fengnian Zhou","doi":"10.1109/JOE.2024.3436907","DOIUrl":"10.1109/JOE.2024.3436907","url":null,"abstract":"Because of water-surface uncertainty, green lasers used in airborne bathymetric LiDAR cannot accurately detect the water surface, as they reflect near-water surface penetration (NWSP) into the water column. The existence of the NWSP of a green laser in water is not beneficial for high-accuracy depth measurements; however, it can be useful for ocean–land interface (OLI) extraction. In this study, novel ocean–land discrimination and interface extraction methods based on the NWSPs of green lasers are proposed. First, the NWSPs of different green laser channels are calculated and averaged to obtain a robust NWSP for each laser footprint. Second, a novel NWSP-based ocean–land discriminator is proposed based on the different characteristics of the NWSPs in land and ocean areas. Third, density-based spatial clustering of applications with noise algorithm is used to identify and correct the misclassified points of the NWSP-based ocean–land discriminator, and the OLIs are formed by connecting the land boundary points. Finally, the novel NWSP method is verified using a raw ABL data set collected via Optech coastal zone mapping and imaging LiDAR. The OLIs derived by waveform clustering are used as reference to evaluate the performance of the proposed NWSP method. OLI extraction based on the proposed NWSP method and the traditional point elevation method can reach accuracies of 1.9 and 4.8 m, respectively, in the research area. The proposed NWSP method provides a novel and convenient means for OLI extraction using the NWSPs of green lasers.","PeriodicalId":13191,"journal":{"name":"IEEE Journal of Oceanic Engineering","volume":"49 4","pages":"1472-1487"},"PeriodicalIF":3.8,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10684015","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142250076","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Entropy-Based Automatic Detection of Marine Mammal Tonal Calls","authors":"Yue Liang;Kerri D. Seger;Nicholas J. Kirsch","doi":"10.1109/JOE.2024.3436867","DOIUrl":"10.1109/JOE.2024.3436867","url":null,"abstract":"Hydrophones are deployed throughout the ocean to perform passive acoustic monitoring. This technique is a powerful tool for marine mammal sound detection due to its advantage of being able to collect data overnight, year-round, and in inclement weather. However, hundreds of terabytes of data produced each year pose a significant challenge for data analysis. The aim of this study was to investigate the use of entropy-based techniques to achieve automatic detection of marine mammal tonal calls in passive acoustic monitoring data. A weighted spectral entropy technique was developed to alleviate the impact of underwater noise along with a novel algorithmic detector. The detector includes an adaptive bandpass filter, a time–frequency domain transform, and a likelihood ratio test for calculating the optimal detection threshold in addition to the Weighted Spectral Entropy Technique. The proposed entropy-based technique and the automatic detector were assessed with synthetic and real-world data and the performance was compared to other state-of-the-art techniques. The results indicate that the proposed method outperforms the other techniques when evaluated using various types of low signal-to-noise ratio tonal signals.","PeriodicalId":13191,"journal":{"name":"IEEE Journal of Oceanic Engineering","volume":"49 4","pages":"1140-1150"},"PeriodicalIF":3.8,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142250071","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Using Cross-Mission SAR Data for a Multidecadal Coastline Change Monitoring and Assessing the Influences of SAR-Related Factors","authors":"Ya-Lun S. Tsai","doi":"10.1109/joe.2024.3425968","DOIUrl":"https://doi.org/10.1109/joe.2024.3425968","url":null,"abstract":"","PeriodicalId":13191,"journal":{"name":"IEEE Journal of Oceanic Engineering","volume":"65 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142250072","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Giovanni Battista Rossi, Gabriele Nardone, Marco Picone, Giulio Settanta, Francesco Crenna, Marta Berardengo
{"title":"Testing High Directional Resolution Sea-Spectrum Estimation Methods in View of the Needs of a National Monitoring System","authors":"Giovanni Battista Rossi, Gabriele Nardone, Marco Picone, Giulio Settanta, Francesco Crenna, Marta Berardengo","doi":"10.1109/joe.2024.3436771","DOIUrl":"https://doi.org/10.1109/joe.2024.3436771","url":null,"abstract":"","PeriodicalId":13191,"journal":{"name":"IEEE Journal of Oceanic Engineering","volume":"4 1","pages":""},"PeriodicalIF":4.1,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142250070","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Proximal Policy-Optimized Regularized Least Squares Algorithm for Noise-Resilient Motion Prediction of UMVs","authors":"Yiming Zhong;Caoyang Yu;Xianbo Xiang;Lian Lian","doi":"10.1109/JOE.2024.3436770","DOIUrl":"https://doi.org/10.1109/JOE.2024.3436770","url":null,"abstract":"To enhance the accuracy of motion prediction in unmanned marine vehicles (UMVs), an innovative proximal policy-optimized regularized least squares (PPO-RLS) algorithm is proposed in this article. This article begins by developing a dynamics model for UMVs that incorporates viscous damping and external forces to minimize modeling errors. However, this model does not account for data noise, making accurate parameter identification difficult when using traditional least squares (LS) algorithms. To overcome this limitation, the PPO-RLS algorithm is proposed, incorporating a regularization term within the LS framework and utilizing proximal policy optimization for adaptive regularization term tuning. The performance of the PPO-RLS algorithm is thoroughly evaluated using both simulation data and lake trial data, demonstrating significant improvements over both the traditional LS algorithm and a state-of-the-art algorithm. Specifically, in simulation tests, the PPO-RLS algorithm achieves a notable reduction in root mean square error for surge velocity (8.49E-03 m/s) and heading angle (2.32\u0000<inline-formula><tex-math>$^circ$</tex-math></inline-formula>\u0000), markedly outperforming the LS algorithm (2.36E-02 m/s for surge velocity and 4.14\u0000<inline-formula><tex-math>$^circ$</tex-math></inline-formula>\u0000 for heading angle). In addition, the PPO-RLS algorithm displays enhanced stability, as indicated by a more than 50% reduction in condition number (1.46E+04 for PPO-RLS versus 2.89E+06 for LS). These improvements are further validated by lake trial data, confirming the algorithm's advanced motion prediction capabilities with quantitatively lower errors and greater robustness.","PeriodicalId":13191,"journal":{"name":"IEEE Journal of Oceanic Engineering","volume":"49 4","pages":"1397-1410"},"PeriodicalIF":3.8,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142438615","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Joseph L. Walker;Zheng Zeng;Chengchen L. Wu;Jules S. Jaffe;Kaitlin E. Frasier;Stuart S. Sandin
{"title":"Underwater Object Detection Under Domain Shift","authors":"Joseph L. Walker;Zheng Zeng;Chengchen L. Wu;Jules S. Jaffe;Kaitlin E. Frasier;Stuart S. Sandin","doi":"10.1109/JOE.2024.3425453","DOIUrl":"10.1109/JOE.2024.3425453","url":null,"abstract":"There is increasing interest in using deep learning–based object recognition algorithms to automate the labeling of image data collected from marine surveys. However, underwater object detection is a particularly challenging problem due to changes in scattering and absorption of light, and spotty data collection efforts, which rarely capture the broad variability. Using deep learning–based object detection systems for long-term or multisite marine surveying is further complicated by shifting data distributions between training and testing stages. Using data from the 100 Island Challenge, we investigate how object detection performance is impacted by changes in site characteristics and imaging conditions. We demonstrate that the combined use of data augmentation and unsupervised domain adaptation techniques can mitigate performance drops in the presence of domain shift. The proposed methodologies are broadly applicable to observational data sets in marine and terrestrial environments where a single algorithm needs to adapt to and perform comparably across changing conditions.","PeriodicalId":13191,"journal":{"name":"IEEE Journal of Oceanic Engineering","volume":"49 4","pages":"1209-1219"},"PeriodicalIF":3.8,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10679365","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142200190","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}