基于声学摄像机的超分辨率重建方法,用于低能见度海洋环境中的水下感知

IF 4.3 2区 工程技术 Q1 ENGINEERING, OCEAN
Xiaoteng Zhou, Katsunori Mizuno
{"title":"基于声学摄像机的超分辨率重建方法,用于低能见度海洋环境中的水下感知","authors":"Xiaoteng Zhou,&nbsp;Katsunori Mizuno","doi":"10.1016/j.apor.2024.104110","DOIUrl":null,"url":null,"abstract":"<div><p>In low-visibility environments, the underwater perception range of optical cameras is severely restricted, and perception operations in ocean engineering often rely on sonar. Acoustic cameras are a type of forward-looking sonar that have attracted considerable attention because of their ability to produce images similar to those of optical cameras. However, owing to the unique imaging mechanism employed by acoustic cameras, the resulting images suffer from insufficient resolution and a loss of feature details. This issue considerably diminishes the precision of downstream visual tasks, limiting the application of acoustic cameras. In this study, we propose a deep-learning-based super-resolution reconstruction approach for acoustic cameras, where the reconstruction process relies only on images, without prior assumptions regarding the detection scenes. We verified the effectiveness of the proposed method for two practical applications: marine debris detection and marine structure inspection. The experimental results show that our proposed method can robustly reconstruct high-resolution sonar images, and the obtained images have superior feature details, which improved the precision of downstream vision tasks. In this study, we aim to provide better solutions for underwater perception in low-visibility marine environments, while exploring the application of acoustic cameras in marine debris detection and structure inspection.</p></div>","PeriodicalId":8261,"journal":{"name":"Applied Ocean Research","volume":null,"pages":null},"PeriodicalIF":4.3000,"publicationDate":"2024-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0141118724002311/pdfft?md5=bffec0d63ffa7bf0cd0a9600c63e3e0c&pid=1-s2.0-S0141118724002311-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Acoustic camera-based super-resolution reconstruction approach for underwater perception in low-visibility marine environments\",\"authors\":\"Xiaoteng Zhou,&nbsp;Katsunori Mizuno\",\"doi\":\"10.1016/j.apor.2024.104110\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>In low-visibility environments, the underwater perception range of optical cameras is severely restricted, and perception operations in ocean engineering often rely on sonar. Acoustic cameras are a type of forward-looking sonar that have attracted considerable attention because of their ability to produce images similar to those of optical cameras. However, owing to the unique imaging mechanism employed by acoustic cameras, the resulting images suffer from insufficient resolution and a loss of feature details. This issue considerably diminishes the precision of downstream visual tasks, limiting the application of acoustic cameras. In this study, we propose a deep-learning-based super-resolution reconstruction approach for acoustic cameras, where the reconstruction process relies only on images, without prior assumptions regarding the detection scenes. We verified the effectiveness of the proposed method for two practical applications: marine debris detection and marine structure inspection. The experimental results show that our proposed method can robustly reconstruct high-resolution sonar images, and the obtained images have superior feature details, which improved the precision of downstream vision tasks. In this study, we aim to provide better solutions for underwater perception in low-visibility marine environments, while exploring the application of acoustic cameras in marine debris detection and structure inspection.</p></div>\",\"PeriodicalId\":8261,\"journal\":{\"name\":\"Applied Ocean Research\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2024-07-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S0141118724002311/pdfft?md5=bffec0d63ffa7bf0cd0a9600c63e3e0c&pid=1-s2.0-S0141118724002311-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Ocean Research\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0141118724002311\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, OCEAN\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Ocean Research","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0141118724002311","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, OCEAN","Score":null,"Total":0}
引用次数: 0

摘要

在低能见度环境中,光学摄像机的水下感知范围受到严重限制,因此海洋工程中的感知操作通常依赖声纳。声学摄像机是前视声纳的一种,因其能够生成与光学摄像机类似的图像而备受关注。然而,由于声学摄像机采用了独特的成像机制,其生成的图像存在分辨率不足和特征细节丢失的问题。这一问题大大降低了下游视觉任务的精度,限制了声学摄像机的应用。在本研究中,我们为声学摄像机提出了一种基于深度学习的超分辨率重建方法,重建过程仅依赖于图像,而无需事先假设检测场景。我们在海洋废弃物检测和海洋结构检测这两个实际应用中验证了所提方法的有效性。实验结果表明,我们提出的方法可以稳健地重建高分辨率声纳图像,所获得的图像具有出色的特征细节,从而提高了下游视觉任务的精度。本研究旨在为低能见度海洋环境中的水下感知提供更好的解决方案,同时探索声学相机在海洋废弃物探测和结构检测中的应用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Acoustic camera-based super-resolution reconstruction approach for underwater perception in low-visibility marine environments

In low-visibility environments, the underwater perception range of optical cameras is severely restricted, and perception operations in ocean engineering often rely on sonar. Acoustic cameras are a type of forward-looking sonar that have attracted considerable attention because of their ability to produce images similar to those of optical cameras. However, owing to the unique imaging mechanism employed by acoustic cameras, the resulting images suffer from insufficient resolution and a loss of feature details. This issue considerably diminishes the precision of downstream visual tasks, limiting the application of acoustic cameras. In this study, we propose a deep-learning-based super-resolution reconstruction approach for acoustic cameras, where the reconstruction process relies only on images, without prior assumptions regarding the detection scenes. We verified the effectiveness of the proposed method for two practical applications: marine debris detection and marine structure inspection. The experimental results show that our proposed method can robustly reconstruct high-resolution sonar images, and the obtained images have superior feature details, which improved the precision of downstream vision tasks. In this study, we aim to provide better solutions for underwater perception in low-visibility marine environments, while exploring the application of acoustic cameras in marine debris detection and structure inspection.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Applied Ocean Research
Applied Ocean Research 地学-工程:大洋
CiteScore
8.70
自引率
7.00%
发文量
316
审稿时长
59 days
期刊介绍: The aim of Applied Ocean Research is to encourage the submission of papers that advance the state of knowledge in a range of topics relevant to ocean engineering.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信