{"title":"优化 3D 重建:应用视觉基础模型进行尺寸测量","authors":"Yan Zeng , Zhengqi Hua , Zejun Xiang , Yue Liao , Feng Huang , Xiaocheng Guo , Yingchuan Peng , Xuesi Liu","doi":"10.1016/j.jcsr.2024.109087","DOIUrl":null,"url":null,"abstract":"<div><div>This study applies a vision foundation model to optimize the Point Cloud Data (PCD) reconstruction pipeline in digital photogrammetry, aiming to overcome the challenges of component PCD acquisition in Small and Medium Construction Projects (SMCP). A hardware device is designed and assembled for overlapping image acquisition. In order to alleviate computational and storage burdens, a vision foundation model is utilized for Region of Interest (ROI) selection before PCD reconstruction, for which a set of prompt optimization methods based on image similarity is proposed. The scale of the reconstructed PCD is calibrated based on the camera pose, enabling precise dimension measurement of the PCD. Two case studies confirm the effectiveness of the optimized method for dimension measurement, with tolerance below 2 mm, corresponding to 6.7 times the pixel accuracy. Furthermore, this method demonstrates substantial improvements in image storage, decreasing by over 84 %, and decreases of over 55 % in PCD storage and over 50 % in the computational time required for reconstruction. These outcomes underscore the practicality and efficiency of the introduced framework in addressing the challenges posed by batch component dimension measurement.</div></div>","PeriodicalId":15557,"journal":{"name":"Journal of Constructional Steel Research","volume":"224 ","pages":"Article 109087"},"PeriodicalIF":4.0000,"publicationDate":"2024-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Optimizing 3D reconstruction: Application of a vision foundation model for dimensional measurement\",\"authors\":\"Yan Zeng , Zhengqi Hua , Zejun Xiang , Yue Liao , Feng Huang , Xiaocheng Guo , Yingchuan Peng , Xuesi Liu\",\"doi\":\"10.1016/j.jcsr.2024.109087\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>This study applies a vision foundation model to optimize the Point Cloud Data (PCD) reconstruction pipeline in digital photogrammetry, aiming to overcome the challenges of component PCD acquisition in Small and Medium Construction Projects (SMCP). A hardware device is designed and assembled for overlapping image acquisition. In order to alleviate computational and storage burdens, a vision foundation model is utilized for Region of Interest (ROI) selection before PCD reconstruction, for which a set of prompt optimization methods based on image similarity is proposed. The scale of the reconstructed PCD is calibrated based on the camera pose, enabling precise dimension measurement of the PCD. Two case studies confirm the effectiveness of the optimized method for dimension measurement, with tolerance below 2 mm, corresponding to 6.7 times the pixel accuracy. Furthermore, this method demonstrates substantial improvements in image storage, decreasing by over 84 %, and decreases of over 55 % in PCD storage and over 50 % in the computational time required for reconstruction. These outcomes underscore the practicality and efficiency of the introduced framework in addressing the challenges posed by batch component dimension measurement.</div></div>\",\"PeriodicalId\":15557,\"journal\":{\"name\":\"Journal of Constructional Steel Research\",\"volume\":\"224 \",\"pages\":\"Article 109087\"},\"PeriodicalIF\":4.0000,\"publicationDate\":\"2024-10-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Constructional Steel Research\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0143974X24006370\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CONSTRUCTION & BUILDING TECHNOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Constructional Steel Research","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0143974X24006370","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CONSTRUCTION & BUILDING TECHNOLOGY","Score":null,"Total":0}
Optimizing 3D reconstruction: Application of a vision foundation model for dimensional measurement
This study applies a vision foundation model to optimize the Point Cloud Data (PCD) reconstruction pipeline in digital photogrammetry, aiming to overcome the challenges of component PCD acquisition in Small and Medium Construction Projects (SMCP). A hardware device is designed and assembled for overlapping image acquisition. In order to alleviate computational and storage burdens, a vision foundation model is utilized for Region of Interest (ROI) selection before PCD reconstruction, for which a set of prompt optimization methods based on image similarity is proposed. The scale of the reconstructed PCD is calibrated based on the camera pose, enabling precise dimension measurement of the PCD. Two case studies confirm the effectiveness of the optimized method for dimension measurement, with tolerance below 2 mm, corresponding to 6.7 times the pixel accuracy. Furthermore, this method demonstrates substantial improvements in image storage, decreasing by over 84 %, and decreases of over 55 % in PCD storage and over 50 % in the computational time required for reconstruction. These outcomes underscore the practicality and efficiency of the introduced framework in addressing the challenges posed by batch component dimension measurement.
期刊介绍:
The Journal of Constructional Steel Research provides an international forum for the presentation and discussion of the latest developments in structural steel research and their applications. It is aimed not only at researchers but also at those likely to be most affected by research results, i.e. designers and fabricators. Original papers of a high standard dealing with all aspects of steel research including theoretical and experimental research on elements, assemblages, connection and material properties are considered for publication.