{"title":"基于深度学习的双光子聚合自动质量检测和印刷优化的双重视觉检测","authors":"Ningning Hu, Lujia Ding, Lijun Men, Wenju Zhou, Wenjun Zhang, Ruixue Yin","doi":"10.1007/s10845-024-02417-z","DOIUrl":null,"url":null,"abstract":"<p>Two-photon polymerization (TPP) has emerged as an advanced additive manufacturing technique, allowing for the creation of three-dimensional micro-nano structures with high precision based on two-photon absorption principle. Precisely control light dosage determined by the printing parameters, is crucial for inducing photopolymerization across different photocurable materials and various structures. To address the challenges of parameter optimization, deep learning models were employed to quickly obtained the ideal printing parameters through automated visual inspection during TPP printing process and after post-processing. A dataset was collected from the video recordings during printing process and the images obtained from after post-processing of samples. Data augmentation techniques were applied to enhance the dataset. For the TPP printing process, the mean prediction accuracy increasing from 95.1% to 96.8% for the 3D-CNN model and from 95.4% to 97.8% for the CNN-LSTM model. For the post-processing, the mean prediction accuracy with CNN model increases from 94.5% to 95.2%. Consequently, spatial–temporal DL models were trained based on these datasets, and the results of dual visual inspection method demonstrated a high accuracy of 93.1% and a rapid recognition time of 48 ms. And an analysis of the failure cases of the deep learning models was conducted. Additionally, the optimal printing parameter ranges was determination for various combinations of materials and structures. This system plays a crucial role in accelerating the optimization of TPP process parameters and quality inspection, effectively addressing the challenges in the industrialization process of TPP technology.</p>","PeriodicalId":16193,"journal":{"name":"Journal of Intelligent Manufacturing","volume":"80 1","pages":""},"PeriodicalIF":5.9000,"publicationDate":"2024-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Dual visual inspection for automated quality detection and printing optimization of two-photon polymerization based on deep learning\",\"authors\":\"Ningning Hu, Lujia Ding, Lijun Men, Wenju Zhou, Wenjun Zhang, Ruixue Yin\",\"doi\":\"10.1007/s10845-024-02417-z\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Two-photon polymerization (TPP) has emerged as an advanced additive manufacturing technique, allowing for the creation of three-dimensional micro-nano structures with high precision based on two-photon absorption principle. Precisely control light dosage determined by the printing parameters, is crucial for inducing photopolymerization across different photocurable materials and various structures. To address the challenges of parameter optimization, deep learning models were employed to quickly obtained the ideal printing parameters through automated visual inspection during TPP printing process and after post-processing. A dataset was collected from the video recordings during printing process and the images obtained from after post-processing of samples. Data augmentation techniques were applied to enhance the dataset. For the TPP printing process, the mean prediction accuracy increasing from 95.1% to 96.8% for the 3D-CNN model and from 95.4% to 97.8% for the CNN-LSTM model. For the post-processing, the mean prediction accuracy with CNN model increases from 94.5% to 95.2%. Consequently, spatial–temporal DL models were trained based on these datasets, and the results of dual visual inspection method demonstrated a high accuracy of 93.1% and a rapid recognition time of 48 ms. And an analysis of the failure cases of the deep learning models was conducted. Additionally, the optimal printing parameter ranges was determination for various combinations of materials and structures. This system plays a crucial role in accelerating the optimization of TPP process parameters and quality inspection, effectively addressing the challenges in the industrialization process of TPP technology.</p>\",\"PeriodicalId\":16193,\"journal\":{\"name\":\"Journal of Intelligent Manufacturing\",\"volume\":\"80 1\",\"pages\":\"\"},\"PeriodicalIF\":5.9000,\"publicationDate\":\"2024-06-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Intelligent Manufacturing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1007/s10845-024-02417-z\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Intelligent Manufacturing","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1007/s10845-024-02417-z","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Dual visual inspection for automated quality detection and printing optimization of two-photon polymerization based on deep learning
Two-photon polymerization (TPP) has emerged as an advanced additive manufacturing technique, allowing for the creation of three-dimensional micro-nano structures with high precision based on two-photon absorption principle. Precisely control light dosage determined by the printing parameters, is crucial for inducing photopolymerization across different photocurable materials and various structures. To address the challenges of parameter optimization, deep learning models were employed to quickly obtained the ideal printing parameters through automated visual inspection during TPP printing process and after post-processing. A dataset was collected from the video recordings during printing process and the images obtained from after post-processing of samples. Data augmentation techniques were applied to enhance the dataset. For the TPP printing process, the mean prediction accuracy increasing from 95.1% to 96.8% for the 3D-CNN model and from 95.4% to 97.8% for the CNN-LSTM model. For the post-processing, the mean prediction accuracy with CNN model increases from 94.5% to 95.2%. Consequently, spatial–temporal DL models were trained based on these datasets, and the results of dual visual inspection method demonstrated a high accuracy of 93.1% and a rapid recognition time of 48 ms. And an analysis of the failure cases of the deep learning models was conducted. Additionally, the optimal printing parameter ranges was determination for various combinations of materials and structures. This system plays a crucial role in accelerating the optimization of TPP process parameters and quality inspection, effectively addressing the challenges in the industrialization process of TPP technology.
期刊介绍:
The Journal of Nonlinear Engineering aims to be a platform for sharing original research results in theoretical, experimental, practical, and applied nonlinear phenomena within engineering. It serves as a forum to exchange ideas and applications of nonlinear problems across various engineering disciplines. Articles are considered for publication if they explore nonlinearities in engineering systems, offering realistic mathematical modeling, utilizing nonlinearity for new designs, stabilizing systems, understanding system behavior through nonlinearity, optimizing systems based on nonlinear interactions, and developing algorithms to harness and leverage nonlinear elements.