Automatic image alignment and stitching for ultrasound-based robotic inspection of complex geometry components

IF 4.1 2区 材料科学 Q1 MATERIALS SCIENCE, CHARACTERIZATION & TESTING
Ekaterina Iakovleva, David Roué, Philippe Brédif
{"title":"Automatic image alignment and stitching for ultrasound-based robotic inspection of complex geometry components","authors":"Ekaterina Iakovleva,&nbsp;David Roué,&nbsp;Philippe Brédif","doi":"10.1016/j.ndteint.2024.103158","DOIUrl":null,"url":null,"abstract":"<div><p>Robotic inspection of complex geometry components using immersion ultrasonic techniques is relevant for many ultrasonic Non-Destructive Testing (NDT) applications in different industries. To image large component, ultrasonic probe is manipulated around the component immersed in water using a robotic guided system to create a tiled image of the entire component. Due to the mechanical vibrations of the high-speed robotic arm, the probe position coordinates provided by the robotic system are not precise enough to ensure an accurate reconstruction (stitching) of a composite image from all individual images. In this work, we propose a stitching method specifically designed to create a single 2D image of the surface of an inspected component from a stack of Total Focusing Method (TFM) images. This stitching method uses Iterative Closest Point (ICP) registration to estimate a 2D rigid transformation between two consecutive 2D images, by maximizing the overlap between the surface geometries extracted from each image. The capabilities of this imaging technique are illustrated by various simulated and experimental results carried out in a water tank. Significant improvements in surface image quality, leading to accurate surface reconstruction, are shown for vertical vibrations with displacements of more than two operating wavelengths and for rotational vibrations with deviation angles of less than 1°. The results also show that the resolving power of the ICP algorithm decreases for strong rotational vibrations.</p></div>","PeriodicalId":18868,"journal":{"name":"Ndt & E International","volume":"146 ","pages":"Article 103158"},"PeriodicalIF":4.1000,"publicationDate":"2024-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0963869524001233/pdfft?md5=7ead7d1fc5b1d6e8aba31162f64a2fb6&pid=1-s2.0-S0963869524001233-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ndt & E International","FirstCategoryId":"88","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0963869524001233","RegionNum":2,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MATERIALS SCIENCE, CHARACTERIZATION & TESTING","Score":null,"Total":0}
引用次数: 0

Abstract

Robotic inspection of complex geometry components using immersion ultrasonic techniques is relevant for many ultrasonic Non-Destructive Testing (NDT) applications in different industries. To image large component, ultrasonic probe is manipulated around the component immersed in water using a robotic guided system to create a tiled image of the entire component. Due to the mechanical vibrations of the high-speed robotic arm, the probe position coordinates provided by the robotic system are not precise enough to ensure an accurate reconstruction (stitching) of a composite image from all individual images. In this work, we propose a stitching method specifically designed to create a single 2D image of the surface of an inspected component from a stack of Total Focusing Method (TFM) images. This stitching method uses Iterative Closest Point (ICP) registration to estimate a 2D rigid transformation between two consecutive 2D images, by maximizing the overlap between the surface geometries extracted from each image. The capabilities of this imaging technique are illustrated by various simulated and experimental results carried out in a water tank. Significant improvements in surface image quality, leading to accurate surface reconstruction, are shown for vertical vibrations with displacements of more than two operating wavelengths and for rotational vibrations with deviation angles of less than 1°. The results also show that the resolving power of the ICP algorithm decreases for strong rotational vibrations.

基于超声波的复杂几何部件机器人检测的自动图像对齐和拼接
使用浸入式超声波技术对几何形状复杂的部件进行机器人检测与不同行业的许多超声波无损检测(NDT)应用相关。为了给大型部件成像,超声波探头通过机器人导向系统在浸入水中的部件周围进行操作,以创建整个部件的平铺图像。由于高速机械臂的机械振动,机器人系统提供的探头位置坐标不够精确,无法确保从所有单个图像精确重建(拼接)合成图像。在这项工作中,我们提出了一种拼接方法,专门用于从全聚焦法 (TFM) 图像堆栈中创建受检部件表面的单一二维图像。这种拼接方法使用迭代最邻近点 (ICP) 注册来估计两个连续二维图像之间的二维刚性变换,方法是从每个图像中提取的表面几何图形之间的重叠最大化。在水箱中进行的各种模拟和实验结果表明了这种成像技术的能力。对于位移超过两个工作波长的垂直振动和偏差角度小于 1° 的旋转振动,表面图像质量有了显著改善,从而实现了精确的表面重建。结果还显示,ICP 算法的分辨能力在强烈旋转振动时会降低。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Ndt & E International
Ndt & E International 工程技术-材料科学:表征与测试
CiteScore
7.20
自引率
9.50%
发文量
121
审稿时长
55 days
期刊介绍: NDT&E international publishes peer-reviewed results of original research and development in all categories of the fields of nondestructive testing and evaluation including ultrasonics, electromagnetics, radiography, optical and thermal methods. In addition to traditional NDE topics, the emerging technology area of inspection of civil structures and materials is also emphasized. The journal publishes original papers on research and development of new inspection techniques and methods, as well as on novel and innovative applications of established methods. Papers on NDE sensors and their applications both for inspection and process control, as well as papers describing novel NDE systems for structural health monitoring and their performance in industrial settings are also considered. Other regular features include international news, new equipment and a calendar of forthcoming worldwide meetings. This journal is listed in Current Contents.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信