从室外超声波图像和变异自动编码器重建三维物体

Ryotaro Ohara;Yuto Yasuda;Riku Hamabe;Shun Sato;Ishii Toru;Shintaro Izumi;Hiroshi Kawaguchi
{"title":"从室外超声波图像和变异自动编码器重建三维物体","authors":"Ryotaro Ohara;Yuto Yasuda;Riku Hamabe;Shun Sato;Ishii Toru;Shintaro Izumi;Hiroshi Kawaguchi","doi":"10.1109/OJUFFC.2024.3466090","DOIUrl":null,"url":null,"abstract":"We present a technique for three-dimensional (3D) object reconstruction utilizing an ultrasonic array sensor and a variational autoencoder (VAE) within a high-interference environment. In scenarios where optical instruments such as cameras and LiDAR are impractical, the utilization of air-coupled ultrasonic waves for 3D measurements has emerged as a viable alternative. Nevertheless, deploying this technology in high-interference settings, particularly outdoor environments, has presented significant challenges. To tackle this challenge, we have developed and established a methodology for the 3D reconstruction of stationary objects by combining the time-of-flight point cloud data acquired through beamforming with the deep learning model VAE. This study proceeds by elucidating the procedure for conducting beamforming and measuring distances using ultrasonic waves. Subsequently, we expound upon an experimental methodology that employs 3D object reconstruction and associated techniques. Finally, we present the results obtained from attaching an ultrasonic sensor to a utility pole and conducting ultrasonic measurements. Our investigation focuses on four distinct types of objects: boxes, motorbikes, humans, and reflectors. The measurement system was positioned 5 m above the ground on a utility pole situated alongside the road. The objects selected for measurement were situated in stationary positions within a \n<inline-formula> <tex-math>$3~\\text {m}^{{3}}$ </tex-math></inline-formula>\n area, with a maximum distance of 10 m from the utility pole. The objective of this study is to assess the efficacy of ultrasonic measurements and object reconstruction techniques under these specified conditions. The results indicate a precision of 0.939, a recall of 0.868, and an F-value of 0.902, which are considered sufficient for the application of ultrasonic waves.","PeriodicalId":73301,"journal":{"name":"IEEE open journal of ultrasonics, ferroelectrics, and frequency control","volume":"4 ","pages":"140-149"},"PeriodicalIF":0.0000,"publicationDate":"2024-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10685487","citationCount":"0","resultStr":"{\"title\":\"3-D Object Reconstruction From Outdoor Ultrasonic Image and Variation Autoencoder\",\"authors\":\"Ryotaro Ohara;Yuto Yasuda;Riku Hamabe;Shun Sato;Ishii Toru;Shintaro Izumi;Hiroshi Kawaguchi\",\"doi\":\"10.1109/OJUFFC.2024.3466090\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"We present a technique for three-dimensional (3D) object reconstruction utilizing an ultrasonic array sensor and a variational autoencoder (VAE) within a high-interference environment. In scenarios where optical instruments such as cameras and LiDAR are impractical, the utilization of air-coupled ultrasonic waves for 3D measurements has emerged as a viable alternative. Nevertheless, deploying this technology in high-interference settings, particularly outdoor environments, has presented significant challenges. To tackle this challenge, we have developed and established a methodology for the 3D reconstruction of stationary objects by combining the time-of-flight point cloud data acquired through beamforming with the deep learning model VAE. This study proceeds by elucidating the procedure for conducting beamforming and measuring distances using ultrasonic waves. Subsequently, we expound upon an experimental methodology that employs 3D object reconstruction and associated techniques. Finally, we present the results obtained from attaching an ultrasonic sensor to a utility pole and conducting ultrasonic measurements. Our investigation focuses on four distinct types of objects: boxes, motorbikes, humans, and reflectors. The measurement system was positioned 5 m above the ground on a utility pole situated alongside the road. The objects selected for measurement were situated in stationary positions within a \\n<inline-formula> <tex-math>$3~\\\\text {m}^{{3}}$ </tex-math></inline-formula>\\n area, with a maximum distance of 10 m from the utility pole. The objective of this study is to assess the efficacy of ultrasonic measurements and object reconstruction techniques under these specified conditions. The results indicate a precision of 0.939, a recall of 0.868, and an F-value of 0.902, which are considered sufficient for the application of ultrasonic waves.\",\"PeriodicalId\":73301,\"journal\":{\"name\":\"IEEE open journal of ultrasonics, ferroelectrics, and frequency control\",\"volume\":\"4 \",\"pages\":\"140-149\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10685487\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE open journal of ultrasonics, ferroelectrics, and frequency control\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10685487/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE open journal of ultrasonics, ferroelectrics, and frequency control","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10685487/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

我们介绍了一种在高干扰环境下利用超声波阵列传感器和变异自动编码器(VAE)重建三维(3D)物体的技术。在相机和激光雷达等光学仪器不可行的情况下,利用空气耦合超声波进行三维测量已成为一种可行的替代方法。然而,在高干扰环境,尤其是室外环境中部署这项技术面临着巨大挑战。为了应对这一挑战,我们开发并建立了一种方法,将通过波束成形获取的飞行时间点云数据与深度学习模型 VAE 相结合,重建静止物体的三维。本研究首先阐明了利用超声波进行波束成形和距离测量的程序。随后,我们阐述了采用三维物体重建和相关技术的实验方法。最后,我们介绍了将超声波传感器安装到电线杆上并进行超声波测量所获得的结果。我们的研究重点是四种不同类型的物体:箱子、摩托车、人和反射器。测量系统安装在离地面 5 米高的路边电线杆上。被选中进行测量的物体位于 3~text {m}^{{3}}$ 区域内的固定位置,与电线杆的最大距离为 10 米。本研究的目的是评估超声波测量和物体重构技术在这些特定条件下的有效性。结果表明,精确度为 0.939,召回率为 0.868,F 值为 0.902,足以应用超声波。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
3-D Object Reconstruction From Outdoor Ultrasonic Image and Variation Autoencoder
We present a technique for three-dimensional (3D) object reconstruction utilizing an ultrasonic array sensor and a variational autoencoder (VAE) within a high-interference environment. In scenarios where optical instruments such as cameras and LiDAR are impractical, the utilization of air-coupled ultrasonic waves for 3D measurements has emerged as a viable alternative. Nevertheless, deploying this technology in high-interference settings, particularly outdoor environments, has presented significant challenges. To tackle this challenge, we have developed and established a methodology for the 3D reconstruction of stationary objects by combining the time-of-flight point cloud data acquired through beamforming with the deep learning model VAE. This study proceeds by elucidating the procedure for conducting beamforming and measuring distances using ultrasonic waves. Subsequently, we expound upon an experimental methodology that employs 3D object reconstruction and associated techniques. Finally, we present the results obtained from attaching an ultrasonic sensor to a utility pole and conducting ultrasonic measurements. Our investigation focuses on four distinct types of objects: boxes, motorbikes, humans, and reflectors. The measurement system was positioned 5 m above the ground on a utility pole situated alongside the road. The objects selected for measurement were situated in stationary positions within a $3~\text {m}^{{3}}$ area, with a maximum distance of 10 m from the utility pole. The objective of this study is to assess the efficacy of ultrasonic measurements and object reconstruction techniques under these specified conditions. The results indicate a precision of 0.939, a recall of 0.868, and an F-value of 0.902, which are considered sufficient for the application of ultrasonic waves.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信