Tatsuki Shimizu, Fusaomi Nagata, Koki Arima, Kohei Miki, Hirohisa Kato, Akimasa Otsuka, Keigo Watanabe, Maki K. Habib
{"title":"利用 Grad-CAM 和随机屏蔽数据增强技术加强工业产品缺陷区域可视化","authors":"Tatsuki Shimizu, Fusaomi Nagata, Koki Arima, Kohei Miki, Hirohisa Kato, Akimasa Otsuka, Keigo Watanabe, Maki K. Habib","doi":"10.1007/s10015-023-00913-8","DOIUrl":null,"url":null,"abstract":"<div><p>Defect detection in various industrial products ensures product quality and safety. This paper introduces an innovative design, training, and evaluation application employing CNN, CAE, YOLO, FCN, and SVM models, to facilitate defect detection without requiring extensive IT expertise. However, conventional usage of Grad-CAM for visualizing defect regions sometimes includes irrelevant areas unrelated to the target defects. A novel data augmentation technique called random masking is proposed to enhance the visualization of defective regions, leading to more accurate and focused defect detection in various industrial products. This technique is used during training, replacing non-target areas in each image with randomly generated mask patterns. The efficacy of the proposed technique is demonstrated through visualization tests of defective regions using Grad-CAM. Furthermore, an ablation study is conducted to assess the effectiveness of the data augmentation techniques, comparing the performance of Grad-CAM with and without random masking augmentation. We further provide insights into the dataset used and present noteworthy findings from the evaluation, showcasing the contributions of our work in advancing defect detection methodologies.</p></div>","PeriodicalId":46050,"journal":{"name":"Artificial Life and Robotics","volume":"29 1","pages":"62 - 69"},"PeriodicalIF":0.8000,"publicationDate":"2023-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Enhancing defective region visualization in industrial products using Grad-CAM and random masking data augmentation\",\"authors\":\"Tatsuki Shimizu, Fusaomi Nagata, Koki Arima, Kohei Miki, Hirohisa Kato, Akimasa Otsuka, Keigo Watanabe, Maki K. Habib\",\"doi\":\"10.1007/s10015-023-00913-8\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Defect detection in various industrial products ensures product quality and safety. This paper introduces an innovative design, training, and evaluation application employing CNN, CAE, YOLO, FCN, and SVM models, to facilitate defect detection without requiring extensive IT expertise. However, conventional usage of Grad-CAM for visualizing defect regions sometimes includes irrelevant areas unrelated to the target defects. A novel data augmentation technique called random masking is proposed to enhance the visualization of defective regions, leading to more accurate and focused defect detection in various industrial products. This technique is used during training, replacing non-target areas in each image with randomly generated mask patterns. The efficacy of the proposed technique is demonstrated through visualization tests of defective regions using Grad-CAM. Furthermore, an ablation study is conducted to assess the effectiveness of the data augmentation techniques, comparing the performance of Grad-CAM with and without random masking augmentation. We further provide insights into the dataset used and present noteworthy findings from the evaluation, showcasing the contributions of our work in advancing defect detection methodologies.</p></div>\",\"PeriodicalId\":46050,\"journal\":{\"name\":\"Artificial Life and Robotics\",\"volume\":\"29 1\",\"pages\":\"62 - 69\"},\"PeriodicalIF\":0.8000,\"publicationDate\":\"2023-11-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Artificial Life and Robotics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://link.springer.com/article/10.1007/s10015-023-00913-8\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"ROBOTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Artificial Life and Robotics","FirstCategoryId":"1085","ListUrlMain":"https://link.springer.com/article/10.1007/s10015-023-00913-8","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ROBOTICS","Score":null,"Total":0}
Enhancing defective region visualization in industrial products using Grad-CAM and random masking data augmentation
Defect detection in various industrial products ensures product quality and safety. This paper introduces an innovative design, training, and evaluation application employing CNN, CAE, YOLO, FCN, and SVM models, to facilitate defect detection without requiring extensive IT expertise. However, conventional usage of Grad-CAM for visualizing defect regions sometimes includes irrelevant areas unrelated to the target defects. A novel data augmentation technique called random masking is proposed to enhance the visualization of defective regions, leading to more accurate and focused defect detection in various industrial products. This technique is used during training, replacing non-target areas in each image with randomly generated mask patterns. The efficacy of the proposed technique is demonstrated through visualization tests of defective regions using Grad-CAM. Furthermore, an ablation study is conducted to assess the effectiveness of the data augmentation techniques, comparing the performance of Grad-CAM with and without random masking augmentation. We further provide insights into the dataset used and present noteworthy findings from the evaluation, showcasing the contributions of our work in advancing defect detection methodologies.