{"title":"结合层次分割和视觉语言推理的空间复杂遮挡MEP点云","authors":"Mingkai Li , Vincent J.L. Gan , Boyu Wang","doi":"10.1016/j.autcon.2025.106455","DOIUrl":null,"url":null,"abstract":"<div><div>3D BIM reconstruction for MEP systems reduces manual documentation and enhances asset information management. However, the complexity of real-world MEP scenes, characterized by their non-linear trajectories within dense and cluttered environment, frequent data incompleteness due to occlusions, poses significant challenge for instance segmentation and geometric modeling. This paper proposes a hierarchical and progressive segmentation framework that integrates deep learning-based semantic segmentation, geometry-driven instance segmentation, and vision-language model-assisted (VLM-assisted) segmentation refinement. The semantic segmentation module achieves an overall accuracy of 87.02 % and mIoU of 69.10 %, with true positive rates exceeding 97 % for pipe, duct, and tray systems. A voxel-based DBSCAN algorithm is developed to enhance clustering stability and efficiency, followed by an improved RANSAC to extract directional primitives. In addition, VLM-assisted 2D projection analysis is introduced to refine segmentation boundaries and support downstream geometric modeling. Experimental results across multiple MEP systems demonstrate that the proposed approach achieves high segmentation accuracy and computational efficiency, without relying on large-scale annotated instance training data.</div></div>","PeriodicalId":8660,"journal":{"name":"Automation in Construction","volume":"179 ","pages":"Article 106455"},"PeriodicalIF":11.5000,"publicationDate":"2025-08-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Integrating hierarchical segmentation and vision-language reasoning for spatially complex and occluded MEP point clouds\",\"authors\":\"Mingkai Li , Vincent J.L. Gan , Boyu Wang\",\"doi\":\"10.1016/j.autcon.2025.106455\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>3D BIM reconstruction for MEP systems reduces manual documentation and enhances asset information management. However, the complexity of real-world MEP scenes, characterized by their non-linear trajectories within dense and cluttered environment, frequent data incompleteness due to occlusions, poses significant challenge for instance segmentation and geometric modeling. This paper proposes a hierarchical and progressive segmentation framework that integrates deep learning-based semantic segmentation, geometry-driven instance segmentation, and vision-language model-assisted (VLM-assisted) segmentation refinement. The semantic segmentation module achieves an overall accuracy of 87.02 % and mIoU of 69.10 %, with true positive rates exceeding 97 % for pipe, duct, and tray systems. A voxel-based DBSCAN algorithm is developed to enhance clustering stability and efficiency, followed by an improved RANSAC to extract directional primitives. In addition, VLM-assisted 2D projection analysis is introduced to refine segmentation boundaries and support downstream geometric modeling. Experimental results across multiple MEP systems demonstrate that the proposed approach achieves high segmentation accuracy and computational efficiency, without relying on large-scale annotated instance training data.</div></div>\",\"PeriodicalId\":8660,\"journal\":{\"name\":\"Automation in Construction\",\"volume\":\"179 \",\"pages\":\"Article 106455\"},\"PeriodicalIF\":11.5000,\"publicationDate\":\"2025-08-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Automation in Construction\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0926580525004959\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CONSTRUCTION & BUILDING TECHNOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Automation in Construction","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0926580525004959","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CONSTRUCTION & BUILDING TECHNOLOGY","Score":null,"Total":0}
Integrating hierarchical segmentation and vision-language reasoning for spatially complex and occluded MEP point clouds
3D BIM reconstruction for MEP systems reduces manual documentation and enhances asset information management. However, the complexity of real-world MEP scenes, characterized by their non-linear trajectories within dense and cluttered environment, frequent data incompleteness due to occlusions, poses significant challenge for instance segmentation and geometric modeling. This paper proposes a hierarchical and progressive segmentation framework that integrates deep learning-based semantic segmentation, geometry-driven instance segmentation, and vision-language model-assisted (VLM-assisted) segmentation refinement. The semantic segmentation module achieves an overall accuracy of 87.02 % and mIoU of 69.10 %, with true positive rates exceeding 97 % for pipe, duct, and tray systems. A voxel-based DBSCAN algorithm is developed to enhance clustering stability and efficiency, followed by an improved RANSAC to extract directional primitives. In addition, VLM-assisted 2D projection analysis is introduced to refine segmentation boundaries and support downstream geometric modeling. Experimental results across multiple MEP systems demonstrate that the proposed approach achieves high segmentation accuracy and computational efficiency, without relying on large-scale annotated instance training data.
期刊介绍:
Automation in Construction is an international journal that focuses on publishing original research papers related to the use of Information Technologies in various aspects of the construction industry. The journal covers topics such as design, engineering, construction technologies, and the maintenance and management of constructed facilities.
The scope of Automation in Construction is extensive and covers all stages of the construction life cycle. This includes initial planning and design, construction of the facility, operation and maintenance, as well as the eventual dismantling and recycling of buildings and engineering structures.