Paulo Henrique dos Santos , Valéria de Carvalho Santos , Eduardo José da Silva Luz
{"title":"Towards robust ferrous scrap material classification with deep learning and conformal prediction","authors":"Paulo Henrique dos Santos , Valéria de Carvalho Santos , Eduardo José da Silva Luz","doi":"10.1016/j.engappai.2024.109724","DOIUrl":null,"url":null,"abstract":"<div><div>The classification of ferrous scrap materials is a well-explored problem in the literature, recognized for its significance in the steel production industry. While deep learning models are effective for this task, their deployment in industrial settings requires addressing model uncertainties and ensuring proper calibration. This study proposes adapting split conformal prediction to quantify uncertainties and facilitate model calibration. The results indicate that the Hierarchical Vision Transformer using Shifted Windows (Swin) models, particularly Swin V2, serves as the most reliable backbone for this task. Although the performance of Swin models is comparable to other evaluated models, Swin V2 demonstrates superior confidence, achieving 95.51% accuracy and the lowest conformal prediction threshold. The method is rigorously evaluated on a real-world dataset comprising 8,147 images across nine classes of ferrous scrap widely used in the Brazilian steel industry. Explainability methods corroborate the results of conformal prediction, enhancing transparency and trust in model predictions, and thereby facilitating industrial adoption. This approach bridges the gap between advanced deep learning and practical application in ferrous scrap classification, underscoring the importance of model calibration in industrial deployment.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"140 ","pages":"Article 109724"},"PeriodicalIF":7.5000,"publicationDate":"2024-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197624018827","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
The classification of ferrous scrap materials is a well-explored problem in the literature, recognized for its significance in the steel production industry. While deep learning models are effective for this task, their deployment in industrial settings requires addressing model uncertainties and ensuring proper calibration. This study proposes adapting split conformal prediction to quantify uncertainties and facilitate model calibration. The results indicate that the Hierarchical Vision Transformer using Shifted Windows (Swin) models, particularly Swin V2, serves as the most reliable backbone for this task. Although the performance of Swin models is comparable to other evaluated models, Swin V2 demonstrates superior confidence, achieving 95.51% accuracy and the lowest conformal prediction threshold. The method is rigorously evaluated on a real-world dataset comprising 8,147 images across nine classes of ferrous scrap widely used in the Brazilian steel industry. Explainability methods corroborate the results of conformal prediction, enhancing transparency and trust in model predictions, and thereby facilitating industrial adoption. This approach bridges the gap between advanced deep learning and practical application in ferrous scrap classification, underscoring the importance of model calibration in industrial deployment.
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.