ThermoPore: Predicting part porosity based on thermal images using deep learning

IF 10.3 1区 工程技术 Q1 ENGINEERING, MANUFACTURING
Peter Pak , Francis Ogoke , Andrew Polonsky , Anthony Garland , Dan S. Bolintineanu , Dan R. Moser , Mary Arnhart , Jonathan Madison , Thomas Ivanoff , John Mitchell , Bradley Jared , Brad Salzbrenner , Michael J. Heiden , Amir Barati Farimani
{"title":"ThermoPore: Predicting part porosity based on thermal images using deep learning","authors":"Peter Pak ,&nbsp;Francis Ogoke ,&nbsp;Andrew Polonsky ,&nbsp;Anthony Garland ,&nbsp;Dan S. Bolintineanu ,&nbsp;Dan R. Moser ,&nbsp;Mary Arnhart ,&nbsp;Jonathan Madison ,&nbsp;Thomas Ivanoff ,&nbsp;John Mitchell ,&nbsp;Bradley Jared ,&nbsp;Brad Salzbrenner ,&nbsp;Michael J. Heiden ,&nbsp;Amir Barati Farimani","doi":"10.1016/j.addma.2024.104503","DOIUrl":null,"url":null,"abstract":"<div><div>Part qualification is often a critical and labor-intensive process in additive manufacturing, particularly in the detection of defects such as porosity, which stands to benefit significantly from advancements in machine learning. We present a deep learning approach for quantifying and localizing <em>ex-situ</em> porosity within Laser Powder Bed Fusion fabricated samples utilizing <em>in-situ</em> thermal image monitoring data. Our goal is to build the real time porosity map of parts based on thermal images acquired during the build. The quantification task builds upon the established Convolutional Neural Network model architecture to predict pore count and the localization task leverages the spatial and temporal attention mechanisms of the novel Video Vision Transformer model to indicate areas of expected porosity. Our model for porosity quantification achieved a <span><math><msup><mrow><mtext>R</mtext></mrow><mrow><mn>2</mn></mrow></msup></math></span> score of 0.57 and our model for porosity localization produced an average Intersection over Union (IoU) score of 0.32 and a maximum of 1.0. This work is setting the foundations of part porosity “Digital Twins” based on additive manufacturing monitoring data and can be applied downstream to reduce time-intensive post-inspection and testing activities during part qualification and certification. In addition, we seek to accelerate the acquisition of crucial insights normally only available through <em>ex-situ</em> part evaluation by means of machine learning analysis of <em>in-situ</em> process monitoring data.</div></div>","PeriodicalId":7172,"journal":{"name":"Additive manufacturing","volume":"95 ","pages":"Article 104503"},"PeriodicalIF":10.3000,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Additive manufacturing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2214860424005499","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MANUFACTURING","Score":null,"Total":0}
引用次数: 0

Abstract

Part qualification is often a critical and labor-intensive process in additive manufacturing, particularly in the detection of defects such as porosity, which stands to benefit significantly from advancements in machine learning. We present a deep learning approach for quantifying and localizing ex-situ porosity within Laser Powder Bed Fusion fabricated samples utilizing in-situ thermal image monitoring data. Our goal is to build the real time porosity map of parts based on thermal images acquired during the build. The quantification task builds upon the established Convolutional Neural Network model architecture to predict pore count and the localization task leverages the spatial and temporal attention mechanisms of the novel Video Vision Transformer model to indicate areas of expected porosity. Our model for porosity quantification achieved a R2 score of 0.57 and our model for porosity localization produced an average Intersection over Union (IoU) score of 0.32 and a maximum of 1.0. This work is setting the foundations of part porosity “Digital Twins” based on additive manufacturing monitoring data and can be applied downstream to reduce time-intensive post-inspection and testing activities during part qualification and certification. In addition, we seek to accelerate the acquisition of crucial insights normally only available through ex-situ part evaluation by means of machine learning analysis of in-situ process monitoring data.
ThermoPore:利用深度学习根据热图像预测零件孔隙率
在增材制造过程中,零件鉴定通常是一个关键的劳动密集型过程,尤其是在检测气孔等缺陷方面,机器学习的进步将使其受益匪浅。我们提出了一种深度学习方法,利用原位热图像监测数据对激光粉末床融合制造样品中的原位气孔进行量化和定位。我们的目标是根据制造过程中获取的热图像,实时绘制零件的孔隙率图。量化任务基于已建立的卷积神经网络模型架构来预测孔隙数量,而定位任务则利用新型视频视觉变换器模型的空间和时间注意机制来指示预期孔隙率区域。我们的孔隙度量化模型的 R2 得分为 0.57,而我们的孔隙度定位模型的平均联合交叉(IoU)得分为 0.32,最高为 1.0。这项工作为基于增材制造监测数据的零件孔隙率 "数字双胞胎 "奠定了基础,并可应用于下游,以减少零件鉴定和认证过程中时间密集的后期检查和测试活动。此外,我们还希望通过对原位过程监控数据进行机器学习分析,加快获得通常只能通过原位零件评估才能获得的重要见解。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Additive manufacturing
Additive manufacturing Materials Science-General Materials Science
CiteScore
19.80
自引率
12.70%
发文量
648
审稿时长
35 days
期刊介绍: Additive Manufacturing stands as a peer-reviewed journal dedicated to delivering high-quality research papers and reviews in the field of additive manufacturing, serving both academia and industry leaders. The journal's objective is to recognize the innovative essence of additive manufacturing and its diverse applications, providing a comprehensive overview of current developments and future prospects. The transformative potential of additive manufacturing technologies in product design and manufacturing is poised to disrupt traditional approaches. In response to this paradigm shift, a distinctive and comprehensive publication outlet was essential. Additive Manufacturing fulfills this need, offering a platform for engineers, materials scientists, and practitioners across academia and various industries to document and share innovations in these evolving technologies.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信