{"title":"A novel DNN tracking algorithm for structural system identification","authors":"Shengyun Peng, Ling-Feng Yan, Bin He, Ying Zhou","doi":"10.12989/SSS.2021.27.5.803","DOIUrl":null,"url":null,"abstract":"In the field of structural health monitoring (SHM), cameras record videos and tracking methods can be applied to calculate the structural displacement. Commercial and unmanned aerial vehicle (UAV) cameras are promising non-contact sensors owning to their high availability and easy installation. However, effective tracking methods need to be developed. In this study, we firstly propose an end-to-end vision measuring framework with a novel deep neural network (DNN) tracker, named Siamese Single Decoder Network (SiamSDN). The system requires no target installation and uses cellphone cameras. For SiamSDN, the position and scale of bounding box are formulated through statistical parameter estimation. Unlike generative trackers, SiamSDN does not require manually extracted features or pre-defined motion areas. The tracking object is solely identified in the first frame. A shaking table test of a five-storey structure is carried out to demonstrate the efficiency. Besides, a UAV is used to simulate the field test. To minimize the error caused by the vibrations of UAV, digital video stabilization (DVS) is proposed to eliminate the drifts. Videos taken by both the commercial and UAV cameras are analyzed to calculate the displacements. Comparing our DNN tracker with feature point matching approach, SiamSDN improves the displacement measuring accuracy by 66.16% and 57.54%, respectively, and the frequency characteristics are obtained precisely.","PeriodicalId":51155,"journal":{"name":"Smart Structures and Systems","volume":"27 1","pages":"803"},"PeriodicalIF":2.1000,"publicationDate":"2021-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Smart Structures and Systems","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.12989/SSS.2021.27.5.803","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, CIVIL","Score":null,"Total":0}
引用次数: 0
Abstract
In the field of structural health monitoring (SHM), cameras record videos and tracking methods can be applied to calculate the structural displacement. Commercial and unmanned aerial vehicle (UAV) cameras are promising non-contact sensors owning to their high availability and easy installation. However, effective tracking methods need to be developed. In this study, we firstly propose an end-to-end vision measuring framework with a novel deep neural network (DNN) tracker, named Siamese Single Decoder Network (SiamSDN). The system requires no target installation and uses cellphone cameras. For SiamSDN, the position and scale of bounding box are formulated through statistical parameter estimation. Unlike generative trackers, SiamSDN does not require manually extracted features or pre-defined motion areas. The tracking object is solely identified in the first frame. A shaking table test of a five-storey structure is carried out to demonstrate the efficiency. Besides, a UAV is used to simulate the field test. To minimize the error caused by the vibrations of UAV, digital video stabilization (DVS) is proposed to eliminate the drifts. Videos taken by both the commercial and UAV cameras are analyzed to calculate the displacements. Comparing our DNN tracker with feature point matching approach, SiamSDN improves the displacement measuring accuracy by 66.16% and 57.54%, respectively, and the frequency characteristics are obtained precisely.
在结构健康监测(SHM)领域,可以采用摄像机记录视频和跟踪方法来计算结构位移。商用和无人机(UAV)相机是非接触式传感器,因为它们的高可用性和易于安装。然而,需要开发有效的跟踪方法。在这项研究中,我们首先提出了一个端到端视觉测量框架,该框架采用了一种新型的深度神经网络(DNN)跟踪器,称为SiamSDN (Siamese Single Decoder network)。该系统不需要目标安装,使用手机摄像头。对于SiamSDN,通过统计参数估计确定边界框的位置和尺度。与生成式跟踪器不同,SiamSDN不需要手动提取特征或预定义的运动区域。跟踪对象在第一帧中被单独识别。通过某五层结构的振动台试验验证了该方法的有效性。此外,还利用一架无人机进行了现场模拟试验。为了最大限度地减少无人机振动引起的误差,提出了数字视频稳定(DVS)来消除漂移。分析商用和无人机摄像机拍摄的视频以计算位移。与特征点匹配方法相比,SiamSDN的位移测量精度分别提高了66.16%和57.54%,并准确地获得了频率特征。
期刊介绍:
An International Journal of Mechatronics, Sensors, Monitoring, Control, Diagnosis, and Management airns at providing a major publication channel for researchers in the general area of smart structures and systems. Typical subjects considered by the journal include:
Sensors/Actuators(Materials/devices/ informatics/networking)
Structural Health Monitoring and Control
Diagnosis/Prognosis
Life Cycle Engineering(planning/design/ maintenance/renewal)
and related areas.