N. Pizurica, Kosta Pavlovic, Slavko Kovacevic, Igor Jovančević
{"title":"Reducing the latency and size of a deep CNN model for surface defect detection in manufacturing","authors":"N. Pizurica, Kosta Pavlovic, Slavko Kovacevic, Igor Jovančević","doi":"10.1117/12.2692962","DOIUrl":"https://doi.org/10.1117/12.2692962","url":null,"abstract":"This paper presents the results of applying optimization techniques, most notably neural architecture search (NAS) and hyperparameter optimization (HPO) strategies, to a known state-of-the-art deep learning model for surface defect detection in industry. It will be shown that it is possible to achieve a significant reduction in model latency and its number of parameters, while incurring only a negligible drop in accuracy. The main motivation for this was deployment of surface defect detection models on edge devices with very limited computational capabilities, e.g. a Raspberry Pi. Such deployment requirements are becoming more and more ubiquitous, as it is very expensive to install and maintain many high-end machines in industrial environments.","PeriodicalId":295011,"journal":{"name":"International Conference on Quality Control by Artificial Vision","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115171365","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The evolution of the non-destructive defect detection in composites with the use of terahertz radiation","authors":"M. Strąg, W. Świderski","doi":"10.1117/12.2690724","DOIUrl":"https://doi.org/10.1117/12.2690724","url":null,"abstract":"The unique properties of Terahertz (THz) radiation include among others the ability to penetrate through electrical insulators such as ceramics, plastics, or plastic composites. Because of that, it is possible to non-destructively and contact free analyze the materials with internal cavities both in transmission and reflection configuration. The commercially available low-power sources provide results which quality is still beyond expectations. As a result, efforts are being made to resolve the studies' focused on optimizing the experimental setup. In the presented work the comparison between two experimental setups operated at the frequencies of 100 GHz and 300 GHz was described. The studies were performed in transmission mode on selected composite material. They were next compared to the results obtained using common pulsed thermography. Some practical application in non-destructive testing and possible improvements of described methods are discussed.","PeriodicalId":295011,"journal":{"name":"International Conference on Quality Control by Artificial Vision","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124281851","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Assya Boughrara, Igor Jovančević, J. Orteu, Mathieu Belloc
{"title":"Inspection of mechanical assemblies based on 3D deep learning segmentation","authors":"Assya Boughrara, Igor Jovančević, J. Orteu, Mathieu Belloc","doi":"10.1117/12.2692569","DOIUrl":"https://doi.org/10.1117/12.2692569","url":null,"abstract":"We are focused on conformity control of complex aeronautical mechanical assemblies, typically an aircraft engine at the end or in the middle of the assembly process. Our overall system should ensure that all the mechanical parts are present and well-mounted. A 3D scanner carried by a robot arm provides acquisitions of 3D point clouds which are further processed. Computer-Aided Design (CAD) model of the mechanical assembly is available. In this paper, we are concentrating on detecting the absence of mechanical elements. Previously we have developed a rendering pipeline for creating realistic synthetic 3D point cloud data. We do this by using the CAD model and taking into account occlusion and self-occlusion of mechanical parts. In this paper, an existing deep neural network for 3D segmentation is experimentally chosen and trained on these synthetic data. Further, the model is evaluated on real data acquired by a 3D scanner and has shown good quantitative results according to a segmentation metric. Finally, when a threshold is applied to the segmentation result, a final decision is made on the absence/presence problem. The achieved accuracy is 98.7%. Our research work is being carried out within the framework of the joint research laboratory ”Inspection 4.0” between IMT Mines Albi/ICA and the company Diota specialized in the development of numerical tools for Industry 4.0. This research is a continuation of the work presented at the QCAV’2021 conference [1].","PeriodicalId":295011,"journal":{"name":"International Conference on Quality Control by Artificial Vision","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125594748","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Image processing through deep learning after DI extraction for the SHM of aeronautic composite structures using Lamb waves","authors":"Salman Husain, M. Rébillat, F. Ababsa","doi":"10.1117/12.2692632","DOIUrl":"https://doi.org/10.1117/12.2692632","url":null,"abstract":"Structural health monitoring (SHM) is a crucial process that enables the diagnosis of the health state of civil and industrial smart structures through autonomous and in-situ non-destructive measurements. The focus of our study is on the damage classification step within the aeronautic context, where the primary objective is to distinguish between different damage types in composite plates. To achieve this, we considered three experimental damages - impact, delamination, and magnet - on an aeronautic composite plate embedded with a piezoelectric array and excited it using ultrasonic guided Lamb waves. We recorded signals resulting from pristine and damaged states and used three methods to create images from the raw recorded data. These methods employed Damage Indexes (DI) that compare signals in the healthy and damaged states for each actuator/sensor path. For the first two methods, images were directly created as pixel maps depicting DI distribution according to the actuator/receiver pairs over the plate. The last method applied the classical RAPID damage localization algorithm, generating damage localization maps associated with a given DI. The datasets generated by the two methods were fed into a Convolutional Neural Network (CNN) for damage classification purposes. Our study demonstrated that the best accuracy for the introduced methods was above 92% for different hyperparameters configurations, indicating their ability to perform the desired SHM damage classification task. The DI-based approach was much more efficient than the RAPID-based method, which was not intuitively expected. These findings contribute to the development of effective SHM techniques for aeronautic composite plates, paving the way for further improvements in this critical field.","PeriodicalId":295011,"journal":{"name":"International Conference on Quality Control by Artificial Vision","volume":"96 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122506980","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Three-dimensional temperature distribution mapping by generative adversarial network in low light environment using thermography","authors":"Shohei Oka, Yonghoon Ji, Hiromitsu Fujii, H. Kono","doi":"10.1117/12.3000051","DOIUrl":"https://doi.org/10.1117/12.3000051","url":null,"abstract":"In this study, we propose a new framework to perform visual simultaneous localization and mapping (SLAM) with RGB images artificially generated from thermal images in low light environments where an optical camera cannot be applied. We applied contrastive unpaired translation (CUT) and enhanced generative adversarial network for super-resolution (ESRGAN), which are image translation methods to generate a clear realistic RGB image from a thermal image. Oriented FAST and rotated BRIEF (ORB)-SLAM was performed using the super-resolution fake RGB image to generate a 3D point cloud. Experimental results showed that our thermography-based visual SLAM could generate a 3D temperature distribution map in the low light environment.","PeriodicalId":295011,"journal":{"name":"International Conference on Quality Control by Artificial Vision","volume":"45 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122854627","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Kevin Helvig, P. Trouvé-Peloux, L. Gavérina, J. Roche, Baptiste Abeloos, C. Pradère
{"title":"Laser flying-spot thermography: an open-access dataset for machine learning and deep learning","authors":"Kevin Helvig, P. Trouvé-Peloux, L. Gavérina, J. Roche, Baptiste Abeloos, C. Pradère","doi":"10.1117/12.3000481","DOIUrl":"https://doi.org/10.1117/12.3000481","url":null,"abstract":"“Flying spot” laser infrared thermography (FST) is a non destructive testing technique able to detect small defects by scanning surfaces with a laser heat source. Defects, such as cracks on metallic parts, are revealed by the disturbance of heat propagation measured by an infrared camera. Deep learning approaches are now very efficient to automatically analyse and use contextual information from data, and can be used for crack detection. However, in the literature only few works deal with the use of deep learning for the crack detection in FST. Indeed obtaining a large amount of data from FST examinations can be expensive and time-consuming. We propose here to build a generic, open-access dataset of laser thermography for defect detection. This database can be used by the community to develop new crack detection methods that can be benchmarked on the same database, as well as for pretraining networks for similar application tasks. We also present results of state of the art detection networks trained with the proposed database. These models give a basis for future works. Dataset, called FLYD (FLYing spot thermography Dataset), will be available in : https://github.com/kevinhelvig/FLYD/.","PeriodicalId":295011,"journal":{"name":"International Conference on Quality Control by Artificial Vision","volume":"96 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128984858","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Performance comparison of division of time and division of focal plan polarimeters","authors":"Pierre-Jean Lapray, L. Bigué","doi":"10.1117/12.2688566","DOIUrl":"https://doi.org/10.1117/12.2688566","url":null,"abstract":"Two typical instruments can be employed for linear polarization imaging: a rotating polarizer in front of a classical monochrome camera (division of time), or a dedicated sensor with a polarization filter array (division of focal-plane). The last method enables the snapshot acquisition of the linear polarization properties of the light with a compact and affordable instrument. The rotating polarizer method has until now been preferred when good polarimetric precision is required. It is still unclear how these two techniques perform comparatively in terms of polarimetric accuracy. This paper provides a practical comparison between the two methods, and evaluates the effect of pre-processing applied on raw images to counterbalance the differences.","PeriodicalId":295011,"journal":{"name":"International Conference on Quality Control by Artificial Vision","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124763185","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Underwater SLAM based on object recognition using YOLO in acoustic images","authors":"Hiroki Nakamura, Takahiro Nonoda, Yonghoon Ji","doi":"10.1117/12.3000053","DOIUrl":"https://doi.org/10.1117/12.3000053","url":null,"abstract":"This paper proposes underwater simultaneous localization and mapping (SLAM) with 3D reconstruction by applying YOLOv7 to acoustic images. In underwater exploration, acoustic cameras, which are called the next generation of ultrasonic sensors, are gradually being applied, and underwater SLAM technologies based on 3D reconstruction with acoustic cameras have been proposed. However, many limitations remain in the accuracy of maps. In this study, we propose a novel approach to improve SLAM accuracy by applying detection results from YOLOv7 in acoustic images to the 3D reconstruction. We utilized the detected objects by YOLOv7 as feature information applied to iterative closest point (ICP)-based SLAM.","PeriodicalId":295011,"journal":{"name":"International Conference on Quality Control by Artificial Vision","volume":"58 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124969392","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Oumaima Sliti, M. Devanne, S. Kohler, N. Samet, Jonathan Weber, C. Cudel
{"title":"f-AnoGAN for non-destructive testing in industrial anomaly detection","authors":"Oumaima Sliti, M. Devanne, S. Kohler, N. Samet, Jonathan Weber, C. Cudel","doi":"10.1117/12.3000063","DOIUrl":"https://doi.org/10.1117/12.3000063","url":null,"abstract":"Being able to identify defects is an essential step during manufacturing processes. Yet, not all defects are necessarily known and sufficiently well described in the databases images. The challenge we address in this paper is to detect any defect by fitting a model using only normal samples of industrial parts. For this purpose, we propose to test fast AnoGAN (f-AnoGAN) approach based on a generative adversarial network (GAN). The method is an unsupervised learning algorithm, that contains two phases; first, we train a generative model using only normal images, which proposes a fast mapping of new data into the latent space. Second, we add and train an encoder to reconstruct images. The anomaly detection is defined by the reconstruction error between the defected data and the reconstructed ones, and the residual error of the discriminator. For our experiments, we use two sets of industrial data; the MVTec Anomaly Detection Dataset and a private dataset which is based on thermal-wave and used for non-destructive testing. This technique has been utilized in research for the evaluation of industrial materials. Applying the f-AnoGAN in this domain offers high anomaly detection accuracy.","PeriodicalId":295011,"journal":{"name":"International Conference on Quality Control by Artificial Vision","volume":"28 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114742368","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Visuo-tactile pose tracking method for in-hand robot manipulation tasks of quotidian objects","authors":"Camille Taglione, C. Mateo, C. Stolz","doi":"10.1117/12.2690812","DOIUrl":"https://doi.org/10.1117/12.2690812","url":null,"abstract":"After more than three decades of research in robot manipulation problems, we observed a considerable level of maturity in different related problems. Many high-performant objects pose tracking exists, one of the main problems for these methods is the robustness again occlusion during in-hand manipulation. This work presents a new multimodal perception approach in order to estimate the pose of an object during an in-hand manipulation. Here, we propose a novel learning-based approach to recover the pose of an object in hand by using a regression method. Particularly, we fuse the visual-based tactile information and depth visual information in order to overpass occlusion problems commonly presented during robot manipulation tasks. Our method is trained and evaluated using simulation. We compare the proposed method against different state-of-the-art approaches to show its robustness in hard scenarios. The recovered results show a reliable increment in performance, while they are obtained using a benchmark in order to obtain replicable and comparable results.","PeriodicalId":295011,"journal":{"name":"International Conference on Quality Control by Artificial Vision","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117050393","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}