{"title":"Fiducial marker-based decentralized computer vision for structural modal identification","authors":"Shivank Mittal, Ayan Sadhu","doi":"10.1016/j.jsv.2025.119152","DOIUrl":null,"url":null,"abstract":"<div><div>Due to the advancement in optics and computer vision, the implementation of the vision-based technique is extensively being investigated for structural health monitoring. Compared with traditional contact sensing measurements, computer-vision technology offers contactless and remote measurements with high spatial density at low cost and instrumentation time. This study proposes an innovative contactless vision-based decentralized vibration measurement technique, where the fiducial marker is utilized as an inexpensive virtual sensor to extract structural vibration measurements using 3D pose estimation through camera calibration. Once the vibration measurements are extracted, covariance-driven stochastic subspace identification is employed due to its robustness for effective mode decomposition and noise reduction capabilities. This paper enables the extraction of 3D time series without deploying a stereo camera system and combines the multiple fields of view of different regions of interest from various cameras in a decentralized manner to capture high-density and high-resolution spatial data for full-field measurement. Two laboratory tests were conducted on a lab-scale building model and a lab-scale beam model to validate the robustness and effectiveness of the proposed methodology. Following the laboratory validation, field tests on a full-scale truss bridge were performed to demonstrate the efficacy of the proposed technique. The relative error in the estimation of the modal frequencies in lab-scale experimentation is <2 %, whereas, for the field study, it is <5.5 %, considering the working distance between the camera and field bridge is over 30 m. The modal assurance criterion (MAC) between the extracted mode shapes is also estimated, and the average MAC values for lab-scale building and lab-scale beam models are 98.61 % and 97.28 %, respectively. The proposed technique has proven to capture the minuscule vibration of the structure at a considerable distance between the structure and the vision-based system, including a detailed comparative study between the vision-based system and accelerometers.</div></div>","PeriodicalId":17233,"journal":{"name":"Journal of Sound and Vibration","volume":"612 ","pages":"Article 119152"},"PeriodicalIF":4.3000,"publicationDate":"2025-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Sound and Vibration","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0022460X25002263","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ACOUSTICS","Score":null,"Total":0}
引用次数: 0
Abstract
Due to the advancement in optics and computer vision, the implementation of the vision-based technique is extensively being investigated for structural health monitoring. Compared with traditional contact sensing measurements, computer-vision technology offers contactless and remote measurements with high spatial density at low cost and instrumentation time. This study proposes an innovative contactless vision-based decentralized vibration measurement technique, where the fiducial marker is utilized as an inexpensive virtual sensor to extract structural vibration measurements using 3D pose estimation through camera calibration. Once the vibration measurements are extracted, covariance-driven stochastic subspace identification is employed due to its robustness for effective mode decomposition and noise reduction capabilities. This paper enables the extraction of 3D time series without deploying a stereo camera system and combines the multiple fields of view of different regions of interest from various cameras in a decentralized manner to capture high-density and high-resolution spatial data for full-field measurement. Two laboratory tests were conducted on a lab-scale building model and a lab-scale beam model to validate the robustness and effectiveness of the proposed methodology. Following the laboratory validation, field tests on a full-scale truss bridge were performed to demonstrate the efficacy of the proposed technique. The relative error in the estimation of the modal frequencies in lab-scale experimentation is <2 %, whereas, for the field study, it is <5.5 %, considering the working distance between the camera and field bridge is over 30 m. The modal assurance criterion (MAC) between the extracted mode shapes is also estimated, and the average MAC values for lab-scale building and lab-scale beam models are 98.61 % and 97.28 %, respectively. The proposed technique has proven to capture the minuscule vibration of the structure at a considerable distance between the structure and the vision-based system, including a detailed comparative study between the vision-based system and accelerometers.
期刊介绍:
The Journal of Sound and Vibration (JSV) is an independent journal devoted to the prompt publication of original papers, both theoretical and experimental, that provide new information on any aspect of sound or vibration. There is an emphasis on fundamental work that has potential for practical application.
JSV was founded and operates on the premise that the subject of sound and vibration requires a journal that publishes papers of a high technical standard across the various subdisciplines, thus facilitating awareness of techniques and discoveries in one area that may be applicable in others.