A novel method for three-dimensional liquid surface topography measurement: Combining binocular vision with deep learning-based digital image correlation

IF 3.7 2区 工程技术 Q2 OPTICS
Fangnan Hao, Yiming Zhang, Zili Xu, Yuhao Zhang, Guang Li
{"title":"A novel method for three-dimensional liquid surface topography measurement: Combining binocular vision with deep learning-based digital image correlation","authors":"Fangnan Hao,&nbsp;Yiming Zhang,&nbsp;Zili Xu,&nbsp;Yuhao Zhang,&nbsp;Guang Li","doi":"10.1016/j.optlaseng.2025.108993","DOIUrl":null,"url":null,"abstract":"<div><div>Liquid surface topography measurement is an urgent need for research on the nonlinear sloshing dynamics of liquids. However, it poses challenges due to liquids' inherent properties like high fluidity, transparency, and specular reflection. The paper proposes a novel method for three-dimensional liquid surface topography measurement combining binocular vision and deep learning-based digital image correlation (Deep-DIC). The method employs a binocular vision system for the acquisition of speckle projection images of the liquid surface. A UNet-based Deep-DIC model is constructed and datasets containing low-contrast, out-of-focus samples are generated for model training in a targeted manner, considering the limitations of liquid measurements. The Deep-DIC-driven spatially dense stereo matching is then conducted and combined with the binocular stereo vision imaging model to achieve three-dimensional liquid surface topography measurements. The method's effectiveness is validated through experimental investigations under static and harmonic excitation conditions. The results of static experiments showcase the ability to reconstruct liquid surfaces with varying heights. The proposed method achieves a maximum mean off-plane error of 1.226 mm with high-quality speckle projection and only 2.342 mm even with low-quality speckle projection, demonstrating clear superiority over traditional DIC. Harmonic excitation experiments further validate the method's capability in capturing dynamic liquid surface vibrations, with results closely aligning with those of finite element method. The relative error between the measured main frequency and the true excitation frequency is only 2.75 %. This study provides a new perspective and has the potential to inform research on liquid sloshing in industrial liquid storage systems.</div></div>","PeriodicalId":49719,"journal":{"name":"Optics and Lasers in Engineering","volume":"191 ","pages":"Article 108993"},"PeriodicalIF":3.7000,"publicationDate":"2025-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics and Lasers in Engineering","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0143816625001800","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OPTICS","Score":null,"Total":0}
引用次数: 0

Abstract

Liquid surface topography measurement is an urgent need for research on the nonlinear sloshing dynamics of liquids. However, it poses challenges due to liquids' inherent properties like high fluidity, transparency, and specular reflection. The paper proposes a novel method for three-dimensional liquid surface topography measurement combining binocular vision and deep learning-based digital image correlation (Deep-DIC). The method employs a binocular vision system for the acquisition of speckle projection images of the liquid surface. A UNet-based Deep-DIC model is constructed and datasets containing low-contrast, out-of-focus samples are generated for model training in a targeted manner, considering the limitations of liquid measurements. The Deep-DIC-driven spatially dense stereo matching is then conducted and combined with the binocular stereo vision imaging model to achieve three-dimensional liquid surface topography measurements. The method's effectiveness is validated through experimental investigations under static and harmonic excitation conditions. The results of static experiments showcase the ability to reconstruct liquid surfaces with varying heights. The proposed method achieves a maximum mean off-plane error of 1.226 mm with high-quality speckle projection and only 2.342 mm even with low-quality speckle projection, demonstrating clear superiority over traditional DIC. Harmonic excitation experiments further validate the method's capability in capturing dynamic liquid surface vibrations, with results closely aligning with those of finite element method. The relative error between the measured main frequency and the true excitation frequency is only 2.75 %. This study provides a new perspective and has the potential to inform research on liquid sloshing in industrial liquid storage systems.
一种三维液体表面形貌测量新方法:双目视觉与基于深度学习的数字图像相关相结合
液体表面形貌测量是研究液体非线性晃动动力学的迫切需要。然而,由于液体的固有特性,如高流动性、透明度和镜面反射,它带来了挑战。提出了一种结合双目视觉和基于深度学习的数字图像相关(deep - dic)的三维液体表面形貌测量新方法。该方法采用双目视觉系统获取液体表面的散斑投影图像。考虑到液体测量的局限性,构建了基于unet的Deep-DIC模型,并有针对性地生成了包含低对比度、失焦样本的数据集,用于模型训练。然后进行deep - dic驱动的空间密集立体匹配,并与双目立体视觉成像模型相结合,实现三维液体表面形貌测量。通过静态和谐波激励条件下的实验研究,验证了该方法的有效性。静态实验结果显示了重建不同高度液体表面的能力。该方法在高质量散斑投影下的最大平均离面误差为1.226 mm,在低质量散斑投影下的最大平均离面误差仅为2.342 mm,与传统DIC相比具有明显的优势。谐波激励实验进一步验证了该方法捕捉液体表面动态振动的能力,其结果与有限元法的结果基本一致。测得的主频率与真实激振频率的相对误差仅为2.75%。这项研究提供了一个新的视角,并有可能为工业液体储存系统中的液体晃动研究提供信息。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Optics and Lasers in Engineering
Optics and Lasers in Engineering 工程技术-光学
CiteScore
8.90
自引率
8.70%
发文量
384
审稿时长
42 days
期刊介绍: Optics and Lasers in Engineering aims at providing an international forum for the interchange of information on the development of optical techniques and laser technology in engineering. Emphasis is placed on contributions targeted at the practical use of methods and devices, the development and enhancement of solutions and new theoretical concepts for experimental methods. Optics and Lasers in Engineering reflects the main areas in which optical methods are being used and developed for an engineering environment. Manuscripts should offer clear evidence of novelty and significance. Papers focusing on parameter optimization or computational issues are not suitable. Similarly, papers focussed on an application rather than the optical method fall outside the journal''s scope. The scope of the journal is defined to include the following: -Optical Metrology- Optical Methods for 3D visualization and virtual engineering- Optical Techniques for Microsystems- Imaging, Microscopy and Adaptive Optics- Computational Imaging- Laser methods in manufacturing- Integrated optical and photonic sensors- Optics and Photonics in Life Science- Hyperspectral and spectroscopic methods- Infrared and Terahertz techniques
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信