{"title":"使用生成对抗网络的超分辨率增强的基于视觉的位移测量","authors":"Chujin Sun, Donglian Gu, Yi Zhang, Xinzheng Lu","doi":"10.1002/stc.3048","DOIUrl":null,"url":null,"abstract":"Monitoring the deformation or displacement response of buildings is critical for structural safety. Recently, the development of computer vision has led to extensive research on the application of vision‐based measurements in the structural monitoring. This enables the use of urban surveillance video cameras, which are widely installed and can produce numerous images and videos of urban scenes to measure the structural displacement. However, the structural displacement measurement may be inaccurate owing to the limited hardware resolution of the surveillance video cameras or the long distance from the cameras to the monitored targets. To this end, this study proposes a method to improve the displacement measurement accuracy using a deep learning super‐resolution model based on generative adversarial networks. The proposed method achieves texture detail enhancement of low‐resolution images or videos by supplementing high‐resolution photographs of the target, thus improving the accuracy of the vision‐based displacement measurement. The proposed method shows good accuracy and stability in both the static and dynamic experimental validations compared with the original low‐resolution images/video and interpolation‐based super‐resolution images/video. In conclusion, the proposed method can support the displacement measurement of buildings and infrastructures based on urban surveillance video cameras.","PeriodicalId":22049,"journal":{"name":"Structural Control and Health Monitoring","volume":"57 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2022-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"10","resultStr":"{\"title\":\"Vision‐based displacement measurement enhanced by super‐resolution using generative adversarial networks\",\"authors\":\"Chujin Sun, Donglian Gu, Yi Zhang, Xinzheng Lu\",\"doi\":\"10.1002/stc.3048\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Monitoring the deformation or displacement response of buildings is critical for structural safety. Recently, the development of computer vision has led to extensive research on the application of vision‐based measurements in the structural monitoring. This enables the use of urban surveillance video cameras, which are widely installed and can produce numerous images and videos of urban scenes to measure the structural displacement. However, the structural displacement measurement may be inaccurate owing to the limited hardware resolution of the surveillance video cameras or the long distance from the cameras to the monitored targets. To this end, this study proposes a method to improve the displacement measurement accuracy using a deep learning super‐resolution model based on generative adversarial networks. The proposed method achieves texture detail enhancement of low‐resolution images or videos by supplementing high‐resolution photographs of the target, thus improving the accuracy of the vision‐based displacement measurement. The proposed method shows good accuracy and stability in both the static and dynamic experimental validations compared with the original low‐resolution images/video and interpolation‐based super‐resolution images/video. In conclusion, the proposed method can support the displacement measurement of buildings and infrastructures based on urban surveillance video cameras.\",\"PeriodicalId\":22049,\"journal\":{\"name\":\"Structural Control and Health Monitoring\",\"volume\":\"57 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-07-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"10\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Structural Control and Health Monitoring\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1002/stc.3048\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Structural Control and Health Monitoring","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1002/stc.3048","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Vision‐based displacement measurement enhanced by super‐resolution using generative adversarial networks
Monitoring the deformation or displacement response of buildings is critical for structural safety. Recently, the development of computer vision has led to extensive research on the application of vision‐based measurements in the structural monitoring. This enables the use of urban surveillance video cameras, which are widely installed and can produce numerous images and videos of urban scenes to measure the structural displacement. However, the structural displacement measurement may be inaccurate owing to the limited hardware resolution of the surveillance video cameras or the long distance from the cameras to the monitored targets. To this end, this study proposes a method to improve the displacement measurement accuracy using a deep learning super‐resolution model based on generative adversarial networks. The proposed method achieves texture detail enhancement of low‐resolution images or videos by supplementing high‐resolution photographs of the target, thus improving the accuracy of the vision‐based displacement measurement. The proposed method shows good accuracy and stability in both the static and dynamic experimental validations compared with the original low‐resolution images/video and interpolation‐based super‐resolution images/video. In conclusion, the proposed method can support the displacement measurement of buildings and infrastructures based on urban surveillance video cameras.