Hang-Young Kim, A. Frommknecht, Bernd Bieberstein, J. Stahl, Marco F. Huber
{"title":"Automated end-of-line quality assurance with visual inspection and convolutional neural networks","authors":"Hang-Young Kim, A. Frommknecht, Bernd Bieberstein, J. Stahl, Marco F. Huber","doi":"10.1515/teme-2022-0092","DOIUrl":null,"url":null,"abstract":"Abstract End-of-line (EOL) quality assurance of finished components has so far required additional manual inspections and burdened manufacturers with high labor costs. To automate the EOL process, in this paper a fully AI-based quality classification system is introduced. The components are automatically placed under the optical inspection system employing a robot. A Convolutional Neural Network (CNN) is used for the quality classification of the recorded images. After quality control, the component is sorted automatically in different bins depending on the quality control result. The trained CNN models achieve up to 98.7% accuracy on the test data. The classification performance of the CNN is compared with that of a rule-based approach. Additionally, the trained classification model is interpreted by an explainable AI method to make it comprehensible for humans and reassure them about its trustworthiness. This work originated from an actual industrial use case from Witzenmann GmbH. Together with the company, a demonstrator was realized.","PeriodicalId":56086,"journal":{"name":"Tm-Technisches Messen","volume":"1 1","pages":"196 - 204"},"PeriodicalIF":0.8000,"publicationDate":"2023-02-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Tm-Technisches Messen","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1515/teme-2022-0092","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"INSTRUMENTS & INSTRUMENTATION","Score":null,"Total":0}
引用次数: 0
Abstract
Abstract End-of-line (EOL) quality assurance of finished components has so far required additional manual inspections and burdened manufacturers with high labor costs. To automate the EOL process, in this paper a fully AI-based quality classification system is introduced. The components are automatically placed under the optical inspection system employing a robot. A Convolutional Neural Network (CNN) is used for the quality classification of the recorded images. After quality control, the component is sorted automatically in different bins depending on the quality control result. The trained CNN models achieve up to 98.7% accuracy on the test data. The classification performance of the CNN is compared with that of a rule-based approach. Additionally, the trained classification model is interpreted by an explainable AI method to make it comprehensible for humans and reassure them about its trustworthiness. This work originated from an actual industrial use case from Witzenmann GmbH. Together with the company, a demonstrator was realized.
期刊介绍:
The journal promotes dialogue between the developers of application-oriented sensors, measurement systems, and measurement methods and the manufacturers and measurement technologists who use them.
Topics
The manufacture and characteristics of new sensors for measurement technology in the industrial sector
New measurement methods
Hardware and software based processing and analysis of measurement signals to obtain measurement values
The outcomes of employing new measurement systems and methods.