基于智能特征匹配的双目立体视觉测波及仿真实验研究

IF 3 2区 生物学 Q1 MARINE & FRESHWATER BIOLOGY
Junjie Wu, Shizhe Chen, Shixuan Liu, Miaomiao Song, Bo Wang, Qingyang Zhang, Yushang Wu, Zhuo Lei, Jiming Zhang, Xingkui Yan, Bin Miao
{"title":"基于智能特征匹配的双目立体视觉测波及仿真实验研究","authors":"Junjie Wu, Shizhe Chen, Shixuan Liu, Miaomiao Song, Bo Wang, Qingyang Zhang, Yushang Wu, Zhuo Lei, Jiming Zhang, Xingkui Yan, Bin Miao","doi":"10.3389/fmars.2024.1508233","DOIUrl":null,"url":null,"abstract":"Waves are crucial in ocean observation and research. Stereo vision-based wave measurement, offering non-contact, low-cost, and intelligent processing, is an emerging method. However, improving accuracy remains a challenge due to wave complexity. This paper presents a novel approach to measure wave height, period, and direction by combining deep learning-based stereo matching with feature matching techniques. To improve the discontinuity and low accuracy in disparity maps from traditional wave image matching algorithms, this paper proposes the use of a high-precision stereo matching method based on Pyramid Stereo Matching Network (PSM-Net).A 3D reconstruction method integrating Scale-Invariant Feature Transform (SIFT) with stereo matching was also introduced to overcome the limitations of template matching and interleaved spectrum methods, which only provide 2D data and fail to capture the full 3D motion of waves. This approach enables accurate wave direction measurement. Additionally, a six-degree-of-freedom platform was proposed to simulate waves, addressing the high costs and attenuation issues of traditional wave tank simulations. Experimental results show the prototype system achieves a wave height accuracy within 5%, period accuracy within 4%, and direction accuracy of ±2°, proving the method’s effectiveness and offering a new approach to stereo vision-based wave measurement.","PeriodicalId":12479,"journal":{"name":"Frontiers in Marine Science","volume":"92 1","pages":""},"PeriodicalIF":3.0000,"publicationDate":"2024-12-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Research on wave measurement and simulation experiments of binocular stereo vision based on intelligent feature matching\",\"authors\":\"Junjie Wu, Shizhe Chen, Shixuan Liu, Miaomiao Song, Bo Wang, Qingyang Zhang, Yushang Wu, Zhuo Lei, Jiming Zhang, Xingkui Yan, Bin Miao\",\"doi\":\"10.3389/fmars.2024.1508233\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Waves are crucial in ocean observation and research. Stereo vision-based wave measurement, offering non-contact, low-cost, and intelligent processing, is an emerging method. However, improving accuracy remains a challenge due to wave complexity. This paper presents a novel approach to measure wave height, period, and direction by combining deep learning-based stereo matching with feature matching techniques. To improve the discontinuity and low accuracy in disparity maps from traditional wave image matching algorithms, this paper proposes the use of a high-precision stereo matching method based on Pyramid Stereo Matching Network (PSM-Net).A 3D reconstruction method integrating Scale-Invariant Feature Transform (SIFT) with stereo matching was also introduced to overcome the limitations of template matching and interleaved spectrum methods, which only provide 2D data and fail to capture the full 3D motion of waves. This approach enables accurate wave direction measurement. Additionally, a six-degree-of-freedom platform was proposed to simulate waves, addressing the high costs and attenuation issues of traditional wave tank simulations. Experimental results show the prototype system achieves a wave height accuracy within 5%, period accuracy within 4%, and direction accuracy of ±2°, proving the method’s effectiveness and offering a new approach to stereo vision-based wave measurement.\",\"PeriodicalId\":12479,\"journal\":{\"name\":\"Frontiers in Marine Science\",\"volume\":\"92 1\",\"pages\":\"\"},\"PeriodicalIF\":3.0000,\"publicationDate\":\"2024-12-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Frontiers in Marine Science\",\"FirstCategoryId\":\"99\",\"ListUrlMain\":\"https://doi.org/10.3389/fmars.2024.1508233\",\"RegionNum\":2,\"RegionCategory\":\"生物学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MARINE & FRESHWATER BIOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in Marine Science","FirstCategoryId":"99","ListUrlMain":"https://doi.org/10.3389/fmars.2024.1508233","RegionNum":2,"RegionCategory":"生物学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MARINE & FRESHWATER BIOLOGY","Score":null,"Total":0}
引用次数: 0

摘要

波浪在海洋观测和研究中是至关重要的。基于立体视觉的波浪测量是一种新兴的非接触、低成本和智能处理的方法。然而,由于波的复杂性,提高精度仍然是一个挑战。将基于深度学习的立体匹配与特征匹配技术相结合,提出了一种测量波浪高度、周期和方向的新方法。针对传统波浪像匹配算法在视差图中存在的不连续和精度低的问题,提出了一种基于金字塔立体匹配网络(PSM-Net)的高精度立体匹配方法。为了克服模板匹配和交错谱法仅提供二维数据而不能捕捉波的三维运动的局限性,提出了一种融合尺度不变特征变换(SIFT)和立体匹配的三维重建方法。这种方法可以精确测量波浪方向。此外,提出了一个六自由度的平台来模拟波浪,解决了传统波浪槽模拟的高成本和衰减问题。实验结果表明,原型系统的波高精度在5%以内,周期精度在4%以内,方向精度为±2°,证明了该方法的有效性,为基于立体视觉的波浪测量提供了一种新的途径。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Research on wave measurement and simulation experiments of binocular stereo vision based on intelligent feature matching
Waves are crucial in ocean observation and research. Stereo vision-based wave measurement, offering non-contact, low-cost, and intelligent processing, is an emerging method. However, improving accuracy remains a challenge due to wave complexity. This paper presents a novel approach to measure wave height, period, and direction by combining deep learning-based stereo matching with feature matching techniques. To improve the discontinuity and low accuracy in disparity maps from traditional wave image matching algorithms, this paper proposes the use of a high-precision stereo matching method based on Pyramid Stereo Matching Network (PSM-Net).A 3D reconstruction method integrating Scale-Invariant Feature Transform (SIFT) with stereo matching was also introduced to overcome the limitations of template matching and interleaved spectrum methods, which only provide 2D data and fail to capture the full 3D motion of waves. This approach enables accurate wave direction measurement. Additionally, a six-degree-of-freedom platform was proposed to simulate waves, addressing the high costs and attenuation issues of traditional wave tank simulations. Experimental results show the prototype system achieves a wave height accuracy within 5%, period accuracy within 4%, and direction accuracy of ±2°, proving the method’s effectiveness and offering a new approach to stereo vision-based wave measurement.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Frontiers in Marine Science
Frontiers in Marine Science Agricultural and Biological Sciences-Aquatic Science
CiteScore
5.10
自引率
16.20%
发文量
2443
审稿时长
14 weeks
期刊介绍: Frontiers in Marine Science publishes rigorously peer-reviewed research that advances our understanding of all aspects of the environment, biology, ecosystem functioning and human interactions with the oceans. Field Chief Editor Carlos M. Duarte at King Abdullah University of Science and Technology Thuwal is supported by an outstanding Editorial Board of international researchers. This multidisciplinary open-access journal is at the forefront of disseminating and communicating scientific knowledge and impactful discoveries to researchers, academics, policy makers and the public worldwide. With the human population predicted to reach 9 billion people by 2050, it is clear that traditional land resources will not suffice to meet the demand for food or energy, required to support high-quality livelihoods. As a result, the oceans are emerging as a source of untapped assets, with new innovative industries, such as aquaculture, marine biotechnology, marine energy and deep-sea mining growing rapidly under a new era characterized by rapid growth of a blue, ocean-based economy. The sustainability of the blue economy is closely dependent on our knowledge about how to mitigate the impacts of the multiple pressures on the ocean ecosystem associated with the increased scale and diversification of industry operations in the ocean and global human pressures on the environment. Therefore, Frontiers in Marine Science particularly welcomes the communication of research outcomes addressing ocean-based solutions for the emerging challenges, including improved forecasting and observational capacities, understanding biodiversity and ecosystem problems, locally and globally, effective management strategies to maintain ocean health, and an improved capacity to sustainably derive resources from the oceans.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信