Kevin Helvig, Pauline Trouvé-Peloux, Ludovic Gaverina, Baptiste Abeloos, Jean-Michel Roche
{"title":"利用深度学习和渐进训练的飞点热成像技术对金属材料进行自动裂纹检测","authors":"Kevin Helvig, Pauline Trouvé-Peloux, Ludovic Gaverina, Baptiste Abeloos, Jean-Michel Roche","doi":"10.1080/17686733.2023.2266176","DOIUrl":null,"url":null,"abstract":"ABSTRACTIn non-destructive testing for metallic materials, ‘Flying-spot’ thermography allows the detection of cracks thanks to the scanning of samples by a local laser heat source observed in the infrared spectrum. However, distinguishing a crack from other surface structures such as air ducts or non-planar shapes on the material surface can be challenging in an automation perspective. To address this, we propose to use deep learning techniques, which can exploit contextual information but require a significant amount of labelled data. This study presents a training method based on curriculum learning and recent denoising diffusion models to generate synthetic images. The protocol progressively increases the complexity of training images, using successively simulated data from a multi-physics finite-element software, synthetically generated data with diffusion process, and finally real data. Several detection scores are measured for various machine learning and deep learning architectures, demonstrating the benefits of the proposed approach for regular application cases and degraded experimental conditions, consisting of limited thermal enlightenment recordings.KEYWORDS: Non-destructive testingflying-spot thermographydeep learningcurriculum learningdenoising diffusion models Disclosure statementNo potential conflict of interest was reported by the author(s).Additional informationFundingThe work was supported by the Agence de l’innovation de Défense.Notes on contributorsKevin HelvigKevin Helvig is a Ph.D. student currently doing research at ONERA Palaiseau in France. His work is dedicated to the application of computer vision techniques to laser thermography for non-destructive materials testing, in particular exploring the coupling between active IR and visible spectrum examinations. He is graduated with an engineering degree from IMT Mines Albi, specializing in non-destructive testing and materials.Pauline Trouvé-PelouxPauline Trouvé-Peloux after completing her engineering training in optics at the Institut d'Optique Graduate School, Pauline Trouvé-Peloux obtained her doctorate in Information and Mathematics Science and Technologies from the Ecole Centrale de Nantes in 2012, specializing in signal and image processing. Since 2012, she has held the position of research engineer at ONERA, within the Information Processing and Systems Department (DTIS). Her research activities focus on the joint design, or co-design, of an imager through joint optimization approaches of its optics and processing parameters. The application areas of her work particularly concern compact 3D sensors for robotics or industrial inspection.Ludovic GaverinaLudovic Gaverina graduated with an engineering degree from Telecom Saint-Etienne and a master of research in optic, image, and computer vision from Jean Monnet University in 2013. In 2017, he received the PhD degree (title of his thesis: “Thermal characterization of heterogeneous material by flying spot laser and infrared thermography”) in heat transfer from Bordeaux University under the supervision of Christophe Pradère. He currently works at ONERA, within the Materials and Structures Departement, focusing on automated multiphysics non-destructive testing (NDT) techniques.Baptiste AbeloosBaptiste Abeloos is a Research Scientist at The French Aerospace Lab ONERA, within the Information Processing and Systems Departement. His PhD thesis, titled ”Searches for Supersymmetry in the Fully Hadronic Channel and Jet Calibration with the ATLAS Detector at the LHC,” focused on enhancing jet energy measurement accuracy and propelling the search for supersymmetry, aiding in extending the known limitations on squark and gluino masses. Currently, he works on deep learning techniques for explainability, vision-language models, and non-destructive testing.Jean-Michel RocheJean Michel Roche is a senior research scientist in ONERA, leader of the R&D team dedicated to non-destructive testing and structural health monitoring. He graduated from Ecole Centrale de Lyon in 2007, specializing in aeroacoustics, and successfully defended his PhD thesis in the field of the absorption of resonant liners, in 2011. Since then, he has been working on thermal-based approaches to detect defects in aeronautic structures.","PeriodicalId":20889,"journal":{"name":"Quantitative InfraRed Thermography","volume":"191 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Automated crack detection on metallic materials with flying-spot thermography using deep learning and progressive training\",\"authors\":\"Kevin Helvig, Pauline Trouvé-Peloux, Ludovic Gaverina, Baptiste Abeloos, Jean-Michel Roche\",\"doi\":\"10.1080/17686733.2023.2266176\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"ABSTRACTIn non-destructive testing for metallic materials, ‘Flying-spot’ thermography allows the detection of cracks thanks to the scanning of samples by a local laser heat source observed in the infrared spectrum. However, distinguishing a crack from other surface structures such as air ducts or non-planar shapes on the material surface can be challenging in an automation perspective. To address this, we propose to use deep learning techniques, which can exploit contextual information but require a significant amount of labelled data. This study presents a training method based on curriculum learning and recent denoising diffusion models to generate synthetic images. The protocol progressively increases the complexity of training images, using successively simulated data from a multi-physics finite-element software, synthetically generated data with diffusion process, and finally real data. Several detection scores are measured for various machine learning and deep learning architectures, demonstrating the benefits of the proposed approach for regular application cases and degraded experimental conditions, consisting of limited thermal enlightenment recordings.KEYWORDS: Non-destructive testingflying-spot thermographydeep learningcurriculum learningdenoising diffusion models Disclosure statementNo potential conflict of interest was reported by the author(s).Additional informationFundingThe work was supported by the Agence de l’innovation de Défense.Notes on contributorsKevin HelvigKevin Helvig is a Ph.D. student currently doing research at ONERA Palaiseau in France. His work is dedicated to the application of computer vision techniques to laser thermography for non-destructive materials testing, in particular exploring the coupling between active IR and visible spectrum examinations. He is graduated with an engineering degree from IMT Mines Albi, specializing in non-destructive testing and materials.Pauline Trouvé-PelouxPauline Trouvé-Peloux after completing her engineering training in optics at the Institut d'Optique Graduate School, Pauline Trouvé-Peloux obtained her doctorate in Information and Mathematics Science and Technologies from the Ecole Centrale de Nantes in 2012, specializing in signal and image processing. Since 2012, she has held the position of research engineer at ONERA, within the Information Processing and Systems Department (DTIS). Her research activities focus on the joint design, or co-design, of an imager through joint optimization approaches of its optics and processing parameters. The application areas of her work particularly concern compact 3D sensors for robotics or industrial inspection.Ludovic GaverinaLudovic Gaverina graduated with an engineering degree from Telecom Saint-Etienne and a master of research in optic, image, and computer vision from Jean Monnet University in 2013. In 2017, he received the PhD degree (title of his thesis: “Thermal characterization of heterogeneous material by flying spot laser and infrared thermography”) in heat transfer from Bordeaux University under the supervision of Christophe Pradère. He currently works at ONERA, within the Materials and Structures Departement, focusing on automated multiphysics non-destructive testing (NDT) techniques.Baptiste AbeloosBaptiste Abeloos is a Research Scientist at The French Aerospace Lab ONERA, within the Information Processing and Systems Departement. His PhD thesis, titled ”Searches for Supersymmetry in the Fully Hadronic Channel and Jet Calibration with the ATLAS Detector at the LHC,” focused on enhancing jet energy measurement accuracy and propelling the search for supersymmetry, aiding in extending the known limitations on squark and gluino masses. Currently, he works on deep learning techniques for explainability, vision-language models, and non-destructive testing.Jean-Michel RocheJean Michel Roche is a senior research scientist in ONERA, leader of the R&D team dedicated to non-destructive testing and structural health monitoring. He graduated from Ecole Centrale de Lyon in 2007, specializing in aeroacoustics, and successfully defended his PhD thesis in the field of the absorption of resonant liners, in 2011. Since then, he has been working on thermal-based approaches to detect defects in aeronautic structures.\",\"PeriodicalId\":20889,\"journal\":{\"name\":\"Quantitative InfraRed Thermography\",\"volume\":\"191 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-10-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Quantitative InfraRed Thermography\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1080/17686733.2023.2266176\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Quantitative InfraRed Thermography","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/17686733.2023.2266176","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
摘要:在金属材料的无损检测中,“飞点”热成像技术通过在红外光谱中观察到的局部激光热源扫描样品,从而可以检测到裂纹。然而,从自动化的角度来看,将裂缝与其他表面结构(如风管或材料表面的非平面形状)区分开来可能具有挑战性。为了解决这个问题,我们建议使用深度学习技术,它可以利用上下文信息,但需要大量的标记数据。本文提出了一种基于课程学习和最新去噪扩散模型的训练方法来生成合成图像。该方案逐步增加训练图像的复杂度,依次使用多物理场有限元软件的模拟数据,通过扩散过程综合生成数据,最后使用真实数据。测量了各种机器学习和深度学习架构的几个检测分数,证明了所提出的方法在常规应用案例和退化实验条件下的优势,包括有限的热启蒙记录。关键词:无损检测飞点热成像深度学习课程学习去噪扩散模型披露声明作者未报告潜在利益冲突。补充资料经费这项工作得到了工发组织的支助。kevin Helvig是一名博士生,目前在法国ONERA Palaiseau做研究。他的工作致力于将计算机视觉技术应用于无损材料的激光热成像检测,特别是探索主动红外和可见光谱检测之间的耦合。他毕业于IMT Mines Albi的工程学位,专门从事无损检测和材料。在完成光学研究所研究生院的光学工程培训后,Pauline trouv - peloux于2012年在法国南特中央学院(Ecole Centrale de Nantes)获得信息与数学科学与技术博士学位,专攻信号和图像处理。自2012年以来,她一直担任ONERA信息处理和系统部(DTIS)的研究工程师。她的研究活动主要集中在通过联合优化其光学和加工参数的方法来联合设计或共同设计成像仪。她的工作应用领域特别关注机器人或工业检测的紧凑型3D传感器。Ludovic Gaverina于2013年毕业于Telecom Saint-Etienne工程学位和Jean Monnet University光学、图像和计算机视觉研究硕士学位。2017年获波尔多大学热传导专业博士学位(论文题目:“非均质材料的飞斑激光和红外热成像热表征”),导师为Christophe prad。他目前在ONERA的材料和结构部门工作,专注于自动化多物理场无损检测(NDT)技术。Baptiste Abeloos是法国航天实验室ONERA信息处理与系统部的研究科学家。他的博士论文题为“在强子通道中寻找超对称,并使用大型强子对撞机的ATLAS探测器进行射流校准”,重点关注提高射流能量测量精度,推动超对称的研究,帮助扩展已知的对夸克和胶子质量的限制。目前,他致力于可解释性、视觉语言模型和非破坏性测试的深度学习技术。Jean-Michel Roche是ONERA的高级研究科学家,致力于无损检测和结构健康监测的研发团队的负责人。他于2007年毕业于里昂中央学院,主修空气声学,并于2011年成功完成了共振衬垫吸收领域的博士论文答辩。从那时起,他一直致力于研究基于热的方法来检测航空结构中的缺陷。
Automated crack detection on metallic materials with flying-spot thermography using deep learning and progressive training
ABSTRACTIn non-destructive testing for metallic materials, ‘Flying-spot’ thermography allows the detection of cracks thanks to the scanning of samples by a local laser heat source observed in the infrared spectrum. However, distinguishing a crack from other surface structures such as air ducts or non-planar shapes on the material surface can be challenging in an automation perspective. To address this, we propose to use deep learning techniques, which can exploit contextual information but require a significant amount of labelled data. This study presents a training method based on curriculum learning and recent denoising diffusion models to generate synthetic images. The protocol progressively increases the complexity of training images, using successively simulated data from a multi-physics finite-element software, synthetically generated data with diffusion process, and finally real data. Several detection scores are measured for various machine learning and deep learning architectures, demonstrating the benefits of the proposed approach for regular application cases and degraded experimental conditions, consisting of limited thermal enlightenment recordings.KEYWORDS: Non-destructive testingflying-spot thermographydeep learningcurriculum learningdenoising diffusion models Disclosure statementNo potential conflict of interest was reported by the author(s).Additional informationFundingThe work was supported by the Agence de l’innovation de Défense.Notes on contributorsKevin HelvigKevin Helvig is a Ph.D. student currently doing research at ONERA Palaiseau in France. His work is dedicated to the application of computer vision techniques to laser thermography for non-destructive materials testing, in particular exploring the coupling between active IR and visible spectrum examinations. He is graduated with an engineering degree from IMT Mines Albi, specializing in non-destructive testing and materials.Pauline Trouvé-PelouxPauline Trouvé-Peloux after completing her engineering training in optics at the Institut d'Optique Graduate School, Pauline Trouvé-Peloux obtained her doctorate in Information and Mathematics Science and Technologies from the Ecole Centrale de Nantes in 2012, specializing in signal and image processing. Since 2012, she has held the position of research engineer at ONERA, within the Information Processing and Systems Department (DTIS). Her research activities focus on the joint design, or co-design, of an imager through joint optimization approaches of its optics and processing parameters. The application areas of her work particularly concern compact 3D sensors for robotics or industrial inspection.Ludovic GaverinaLudovic Gaverina graduated with an engineering degree from Telecom Saint-Etienne and a master of research in optic, image, and computer vision from Jean Monnet University in 2013. In 2017, he received the PhD degree (title of his thesis: “Thermal characterization of heterogeneous material by flying spot laser and infrared thermography”) in heat transfer from Bordeaux University under the supervision of Christophe Pradère. He currently works at ONERA, within the Materials and Structures Departement, focusing on automated multiphysics non-destructive testing (NDT) techniques.Baptiste AbeloosBaptiste Abeloos is a Research Scientist at The French Aerospace Lab ONERA, within the Information Processing and Systems Departement. His PhD thesis, titled ”Searches for Supersymmetry in the Fully Hadronic Channel and Jet Calibration with the ATLAS Detector at the LHC,” focused on enhancing jet energy measurement accuracy and propelling the search for supersymmetry, aiding in extending the known limitations on squark and gluino masses. Currently, he works on deep learning techniques for explainability, vision-language models, and non-destructive testing.Jean-Michel RocheJean Michel Roche is a senior research scientist in ONERA, leader of the R&D team dedicated to non-destructive testing and structural health monitoring. He graduated from Ecole Centrale de Lyon in 2007, specializing in aeroacoustics, and successfully defended his PhD thesis in the field of the absorption of resonant liners, in 2011. Since then, he has been working on thermal-based approaches to detect defects in aeronautic structures.