Fangjun Wang, Jianhao Wu, Zhouwang Yang, Yanzhi Song
{"title":"利用数字双胞胎进行工业视觉检测:连接 CAD 模型与现实场景","authors":"Fangjun Wang, Jianhao Wu, Zhouwang Yang, Yanzhi Song","doi":"10.1007/s10845-024-02485-1","DOIUrl":null,"url":null,"abstract":"<p>This study introduces a new industrial visual inspection method that emphasizes the application of computer-aided design (CAD) models. This method significantly reduces the dependence on acquiring and annotating extensive real-scene data, subsequently expediting the development of visual inspection models. The paper highlights two pivotal contributions. Firstly, we introduce a configurable 3D rendering technology that digitally simulates different states of the product, achieving automatic batch generation and labeling of training data. This feature distinguishes our work from existing methods. Secondly, we designed a domain generalization method based on second-order statistics. This approach effectively addresses the domain shift challenge between synthetic and actual production data, enhancing the model’s generalization capabilities. This represents a noteworthy advancement in the field as it boosts the model’s adaptability to real-world scenarios. Our method has demonstrated impressive performance, achieving accuracy rates of 94.30<span>\\(\\%\\)</span>, 96.75<span>\\(\\%\\)</span>, and 97.35<span>\\(\\%\\)</span> on component model classification, motor defect recognition, and rotating motor brush holder datasets, respectively. These results not only validate the efficacy of our domain generalization method but also underscore the potential of using CAD model data for industrial visual inspection. In summary, our research has created a new method for integrating industrial visual inspection into digital twin ecosystems, highlighting the potential for significant improvements in this field.</p>","PeriodicalId":16193,"journal":{"name":"Journal of Intelligent Manufacturing","volume":"186 1","pages":""},"PeriodicalIF":5.9000,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Industrial vision inspection using digital twins: bridging CAD models and realistic scenarios\",\"authors\":\"Fangjun Wang, Jianhao Wu, Zhouwang Yang, Yanzhi Song\",\"doi\":\"10.1007/s10845-024-02485-1\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>This study introduces a new industrial visual inspection method that emphasizes the application of computer-aided design (CAD) models. This method significantly reduces the dependence on acquiring and annotating extensive real-scene data, subsequently expediting the development of visual inspection models. The paper highlights two pivotal contributions. Firstly, we introduce a configurable 3D rendering technology that digitally simulates different states of the product, achieving automatic batch generation and labeling of training data. This feature distinguishes our work from existing methods. Secondly, we designed a domain generalization method based on second-order statistics. This approach effectively addresses the domain shift challenge between synthetic and actual production data, enhancing the model’s generalization capabilities. This represents a noteworthy advancement in the field as it boosts the model’s adaptability to real-world scenarios. Our method has demonstrated impressive performance, achieving accuracy rates of 94.30<span>\\\\(\\\\%\\\\)</span>, 96.75<span>\\\\(\\\\%\\\\)</span>, and 97.35<span>\\\\(\\\\%\\\\)</span> on component model classification, motor defect recognition, and rotating motor brush holder datasets, respectively. These results not only validate the efficacy of our domain generalization method but also underscore the potential of using CAD model data for industrial visual inspection. In summary, our research has created a new method for integrating industrial visual inspection into digital twin ecosystems, highlighting the potential for significant improvements in this field.</p>\",\"PeriodicalId\":16193,\"journal\":{\"name\":\"Journal of Intelligent Manufacturing\",\"volume\":\"186 1\",\"pages\":\"\"},\"PeriodicalIF\":5.9000,\"publicationDate\":\"2024-09-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Intelligent Manufacturing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1007/s10845-024-02485-1\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Intelligent Manufacturing","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1007/s10845-024-02485-1","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Industrial vision inspection using digital twins: bridging CAD models and realistic scenarios
This study introduces a new industrial visual inspection method that emphasizes the application of computer-aided design (CAD) models. This method significantly reduces the dependence on acquiring and annotating extensive real-scene data, subsequently expediting the development of visual inspection models. The paper highlights two pivotal contributions. Firstly, we introduce a configurable 3D rendering technology that digitally simulates different states of the product, achieving automatic batch generation and labeling of training data. This feature distinguishes our work from existing methods. Secondly, we designed a domain generalization method based on second-order statistics. This approach effectively addresses the domain shift challenge between synthetic and actual production data, enhancing the model’s generalization capabilities. This represents a noteworthy advancement in the field as it boosts the model’s adaptability to real-world scenarios. Our method has demonstrated impressive performance, achieving accuracy rates of 94.30\(\%\), 96.75\(\%\), and 97.35\(\%\) on component model classification, motor defect recognition, and rotating motor brush holder datasets, respectively. These results not only validate the efficacy of our domain generalization method but also underscore the potential of using CAD model data for industrial visual inspection. In summary, our research has created a new method for integrating industrial visual inspection into digital twin ecosystems, highlighting the potential for significant improvements in this field.
期刊介绍:
The Journal of Nonlinear Engineering aims to be a platform for sharing original research results in theoretical, experimental, practical, and applied nonlinear phenomena within engineering. It serves as a forum to exchange ideas and applications of nonlinear problems across various engineering disciplines. Articles are considered for publication if they explore nonlinearities in engineering systems, offering realistic mathematical modeling, utilizing nonlinearity for new designs, stabilizing systems, understanding system behavior through nonlinearity, optimizing systems based on nonlinear interactions, and developing algorithms to harness and leverage nonlinear elements.