Guo Dong Goh, Nur Muizzu Bin Hamzah, Wai Yee Yeong
{"title":"利用机器学习在熔丝制造中进行异常检测。","authors":"Guo Dong Goh, Nur Muizzu Bin Hamzah, Wai Yee Yeong","doi":"10.1089/3dp.2021.0231","DOIUrl":null,"url":null,"abstract":"<p><p>Fused filament fabrication (FFF) has been widely used in various industries, and the adoption of technology is growing significantly. However, the FFF process has several disadvantages like inconsistent part quality and print repeatability. The occurrence of manufacturing-induced defects often leads to these shortcomings. This study aims to develop and implement an on-site monitoring system, which consists of a camera attached to the print head and the laptop that processes the video feed, for the extrusion-based 3D printers incorporating computer vision and object detection models to detect defects and make corrections in real-time. Image data from two classes of defects were collected to train the model. Various YOLO architectures were evaluated to study the ability to detect and classify printing anomalies such as under-extrusion and over-extrusion. Four of the trained models, YOLOv3 and YOLOv4 with \"Tiny\" variation, achieved a mean average precision score of >80% using the AP50 metric. Subsequently, two of the models (YOLOv3-Tiny 100 and 300 epochs) were optimized using Open Neural Network Exchange (ONNX) model conversion and ONNX Runtime to improve the inference speed. A classification accuracy rate of 89.8% and an inference speed of 70 frames per second were obtained. Before implementing the on-site monitoring system, a correction algorithm was developed to perform simple corrective actions based on defect classification. The G-codes of the corrective actions were sent to the printers during the printing process. This implementation successfully demonstrated real-time monitoring and autonomous correction during the FFF 3D printing process. This implementation will pave the way for an on-site monitoring and correction system through closed-loop feedback from other additive manufacturing (AM) processes.</p>","PeriodicalId":54341,"journal":{"name":"3D Printing and Additive Manufacturing","volume":"10 3","pages":"428-437"},"PeriodicalIF":2.3000,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10280217/pdf/","citationCount":"0","resultStr":"{\"title\":\"Anomaly Detection in Fused Filament Fabrication Using Machine Learning.\",\"authors\":\"Guo Dong Goh, Nur Muizzu Bin Hamzah, Wai Yee Yeong\",\"doi\":\"10.1089/3dp.2021.0231\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Fused filament fabrication (FFF) has been widely used in various industries, and the adoption of technology is growing significantly. However, the FFF process has several disadvantages like inconsistent part quality and print repeatability. The occurrence of manufacturing-induced defects often leads to these shortcomings. This study aims to develop and implement an on-site monitoring system, which consists of a camera attached to the print head and the laptop that processes the video feed, for the extrusion-based 3D printers incorporating computer vision and object detection models to detect defects and make corrections in real-time. Image data from two classes of defects were collected to train the model. Various YOLO architectures were evaluated to study the ability to detect and classify printing anomalies such as under-extrusion and over-extrusion. Four of the trained models, YOLOv3 and YOLOv4 with \\\"Tiny\\\" variation, achieved a mean average precision score of >80% using the AP50 metric. Subsequently, two of the models (YOLOv3-Tiny 100 and 300 epochs) were optimized using Open Neural Network Exchange (ONNX) model conversion and ONNX Runtime to improve the inference speed. A classification accuracy rate of 89.8% and an inference speed of 70 frames per second were obtained. Before implementing the on-site monitoring system, a correction algorithm was developed to perform simple corrective actions based on defect classification. The G-codes of the corrective actions were sent to the printers during the printing process. This implementation successfully demonstrated real-time monitoring and autonomous correction during the FFF 3D printing process. This implementation will pave the way for an on-site monitoring and correction system through closed-loop feedback from other additive manufacturing (AM) processes.</p>\",\"PeriodicalId\":54341,\"journal\":{\"name\":\"3D Printing and Additive Manufacturing\",\"volume\":\"10 3\",\"pages\":\"428-437\"},\"PeriodicalIF\":2.3000,\"publicationDate\":\"2023-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10280217/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"3D Printing and Additive Manufacturing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1089/3dp.2021.0231\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2023/6/8 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, MANUFACTURING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"3D Printing and Additive Manufacturing","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1089/3dp.2021.0231","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/6/8 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"ENGINEERING, MANUFACTURING","Score":null,"Total":0}
引用次数: 0
摘要
熔融长丝制造(FFF)已广泛应用于各行各业,其采用率也在大幅增长。然而,熔融长丝制造工艺也存在一些缺点,如零件质量不稳定和打印重复性差。制造过程中产生的缺陷往往会导致这些缺点。本研究旨在为基于挤压的 3D 打印机开发和实施一套现场监控系统,该系统由连接到打印头的摄像头和处理视频馈送的笔记本电脑组成,结合计算机视觉和物体检测模型来检测缺陷并进行实时修正。收集了两类缺陷的图像数据来训练模型。对各种 YOLO 架构进行了评估,以研究其检测和分类印刷异常(如挤压不足和挤压过度)的能力。使用 AP50 指标,四个训练模型(YOLOv3 和 YOLOv4,带 "微小 "变化)的平均精度大于 80%。随后,利用开放神经网络交换(ONNX)模型转换和 ONNX Runtime 对其中两个模型(YOLOv3-Tiny 100 和 300 epochs)进行了优化,以提高推理速度。分类准确率为 89.8%,推理速度为每秒 70 帧。在实施现场监控系统之前,开发了一种修正算法,可根据缺陷分类执行简单的纠正措施。纠正措施的 G 代码在印刷过程中发送给印刷商。这次实施成功地展示了在 FFF 3D 打印过程中的实时监控和自主纠正。该实施方案将为通过其他增材制造 (AM) 过程的闭环反馈实现现场监控和纠正系统铺平道路。
Anomaly Detection in Fused Filament Fabrication Using Machine Learning.
Fused filament fabrication (FFF) has been widely used in various industries, and the adoption of technology is growing significantly. However, the FFF process has several disadvantages like inconsistent part quality and print repeatability. The occurrence of manufacturing-induced defects often leads to these shortcomings. This study aims to develop and implement an on-site monitoring system, which consists of a camera attached to the print head and the laptop that processes the video feed, for the extrusion-based 3D printers incorporating computer vision and object detection models to detect defects and make corrections in real-time. Image data from two classes of defects were collected to train the model. Various YOLO architectures were evaluated to study the ability to detect and classify printing anomalies such as under-extrusion and over-extrusion. Four of the trained models, YOLOv3 and YOLOv4 with "Tiny" variation, achieved a mean average precision score of >80% using the AP50 metric. Subsequently, two of the models (YOLOv3-Tiny 100 and 300 epochs) were optimized using Open Neural Network Exchange (ONNX) model conversion and ONNX Runtime to improve the inference speed. A classification accuracy rate of 89.8% and an inference speed of 70 frames per second were obtained. Before implementing the on-site monitoring system, a correction algorithm was developed to perform simple corrective actions based on defect classification. The G-codes of the corrective actions were sent to the printers during the printing process. This implementation successfully demonstrated real-time monitoring and autonomous correction during the FFF 3D printing process. This implementation will pave the way for an on-site monitoring and correction system through closed-loop feedback from other additive manufacturing (AM) processes.
期刊介绍:
3D Printing and Additive Manufacturing is a peer-reviewed journal that provides a forum for world-class research in additive manufacturing and related technologies. The Journal explores emerging challenges and opportunities ranging from new developments of processes and materials, to new simulation and design tools, and informative applications and case studies. Novel applications in new areas, such as medicine, education, bio-printing, food printing, art and architecture, are also encouraged.
The Journal addresses the important questions surrounding this powerful and growing field, including issues in policy and law, intellectual property, data standards, safety and liability, environmental impact, social, economic, and humanitarian implications, and emerging business models at the industrial and consumer scales.