Chunlei Meng , Jiacheng Yang , Wei Lin , Linqiang Hu , Bowen Liu , Zhuo Zou , LiDa Xu , Zhongxue Gan , Chun Ouyang
{"title":"面向表面缺陷分类的多粒度师生联合表征学习","authors":"Chunlei Meng , Jiacheng Yang , Wei Lin , Linqiang Hu , Bowen Liu , Zhuo Zou , LiDa Xu , Zhongxue Gan , Chun Ouyang","doi":"10.1016/j.jii.2025.100958","DOIUrl":null,"url":null,"abstract":"<div><div>Surface defect classification (SDC) plays a critical role in ensuring product quality within industrial systems. Surface defects are characterized by complex noise backgrounds, diverse defect types, and multi-scale defect shapes. Existing methods often struggle to effectively learn multi-grained defect information in such complex environments. This study introduces a Multi-Grained Teacher-Student Joint Representation Learning (MGJR) framework, which integrates both coarse-grained and fine-grained representation learning in a unified architecture. A ViT-based teacher network first learns holistic global features from defect-rich backgrounds. These features guide a student network enhanced with an Integrated Efficient Multi-Attention (IEMA) module and a Global-Local Attention (GL-Attention) mechanism, enabling the extraction and fusion of multi-scale features to preserve context while emphasizing local anomalies. Additionally, the anchor-guided training strategy (AGTS) serves as a consistency constraint, enhancing robustness by aligning the teacher’s stable coarse-grained signal with the student model’s fine-grained response under noisy inputs. The entire framework is optimized end-to-end using a unified loss that combines coarse-level guidance with task-specific supervision. Extensive experiments demonstrate that MGJR achieves 99.98% accuracy on the NEU-CLS dataset and consistently outperforms previous methods across multiple industrial benchmarks. The model remains lightweight, with 21.14 million parameters and 2.86 billion FLOPs. MGJR shows good performance in noisy conditions and other classification tasks. To demonstrate its practical effectiveness, this study built a wood surface defect dataset with 7 defect types and 2,654 images from real industrial settings. MGJR achieved top performance on this dataset, verifying its applicability in real-world.</div></div>","PeriodicalId":55975,"journal":{"name":"Journal of Industrial Information Integration","volume":"48 ","pages":"Article 100958"},"PeriodicalIF":10.4000,"publicationDate":"2025-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Multi-grained teacher–student joint representation learning for surface defect classification\",\"authors\":\"Chunlei Meng , Jiacheng Yang , Wei Lin , Linqiang Hu , Bowen Liu , Zhuo Zou , LiDa Xu , Zhongxue Gan , Chun Ouyang\",\"doi\":\"10.1016/j.jii.2025.100958\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Surface defect classification (SDC) plays a critical role in ensuring product quality within industrial systems. Surface defects are characterized by complex noise backgrounds, diverse defect types, and multi-scale defect shapes. Existing methods often struggle to effectively learn multi-grained defect information in such complex environments. This study introduces a Multi-Grained Teacher-Student Joint Representation Learning (MGJR) framework, which integrates both coarse-grained and fine-grained representation learning in a unified architecture. A ViT-based teacher network first learns holistic global features from defect-rich backgrounds. These features guide a student network enhanced with an Integrated Efficient Multi-Attention (IEMA) module and a Global-Local Attention (GL-Attention) mechanism, enabling the extraction and fusion of multi-scale features to preserve context while emphasizing local anomalies. Additionally, the anchor-guided training strategy (AGTS) serves as a consistency constraint, enhancing robustness by aligning the teacher’s stable coarse-grained signal with the student model’s fine-grained response under noisy inputs. The entire framework is optimized end-to-end using a unified loss that combines coarse-level guidance with task-specific supervision. Extensive experiments demonstrate that MGJR achieves 99.98% accuracy on the NEU-CLS dataset and consistently outperforms previous methods across multiple industrial benchmarks. The model remains lightweight, with 21.14 million parameters and 2.86 billion FLOPs. MGJR shows good performance in noisy conditions and other classification tasks. To demonstrate its practical effectiveness, this study built a wood surface defect dataset with 7 defect types and 2,654 images from real industrial settings. MGJR achieved top performance on this dataset, verifying its applicability in real-world.</div></div>\",\"PeriodicalId\":55975,\"journal\":{\"name\":\"Journal of Industrial Information Integration\",\"volume\":\"48 \",\"pages\":\"Article 100958\"},\"PeriodicalIF\":10.4000,\"publicationDate\":\"2025-09-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Industrial Information Integration\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2452414X25001815\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Industrial Information Integration","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2452414X25001815","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
Multi-grained teacher–student joint representation learning for surface defect classification
Surface defect classification (SDC) plays a critical role in ensuring product quality within industrial systems. Surface defects are characterized by complex noise backgrounds, diverse defect types, and multi-scale defect shapes. Existing methods often struggle to effectively learn multi-grained defect information in such complex environments. This study introduces a Multi-Grained Teacher-Student Joint Representation Learning (MGJR) framework, which integrates both coarse-grained and fine-grained representation learning in a unified architecture. A ViT-based teacher network first learns holistic global features from defect-rich backgrounds. These features guide a student network enhanced with an Integrated Efficient Multi-Attention (IEMA) module and a Global-Local Attention (GL-Attention) mechanism, enabling the extraction and fusion of multi-scale features to preserve context while emphasizing local anomalies. Additionally, the anchor-guided training strategy (AGTS) serves as a consistency constraint, enhancing robustness by aligning the teacher’s stable coarse-grained signal with the student model’s fine-grained response under noisy inputs. The entire framework is optimized end-to-end using a unified loss that combines coarse-level guidance with task-specific supervision. Extensive experiments demonstrate that MGJR achieves 99.98% accuracy on the NEU-CLS dataset and consistently outperforms previous methods across multiple industrial benchmarks. The model remains lightweight, with 21.14 million parameters and 2.86 billion FLOPs. MGJR shows good performance in noisy conditions and other classification tasks. To demonstrate its practical effectiveness, this study built a wood surface defect dataset with 7 defect types and 2,654 images from real industrial settings. MGJR achieved top performance on this dataset, verifying its applicability in real-world.
期刊介绍:
The Journal of Industrial Information Integration focuses on the industry's transition towards industrial integration and informatization, covering not only hardware and software but also information integration. It serves as a platform for promoting advances in industrial information integration, addressing challenges, issues, and solutions in an interdisciplinary forum for researchers, practitioners, and policy makers.
The Journal of Industrial Information Integration welcomes papers on foundational, technical, and practical aspects of industrial information integration, emphasizing the complex and cross-disciplinary topics that arise in industrial integration. Techniques from mathematical science, computer science, computer engineering, electrical and electronic engineering, manufacturing engineering, and engineering management are crucial in this context.