Junhua Zheng;Le Zhou;Yuting Lyu;Zeyu Yang;Zhiqiang Ge
{"title":"Multi-Rate Data Distillation for Deep Process Monitoring","authors":"Junhua Zheng;Le Zhou;Yuting Lyu;Zeyu Yang;Zhiqiang Ge","doi":"10.1109/TIM.2025.3571076","DOIUrl":null,"url":null,"abstract":"The feature of multiple data sampling rates is among the most common natures in data-driven industrial process monitoring, which may have a significant impact on its performance, in terms of false alarm, monitoring sensitivity, computational complexity, and manpower resources. Instead of continuously polishing the model structure as usual, this article proposes a cumulative data distillation strategy under the deep monitoring framework. Without increasing the number of training samples, data distillation explores more effective information through compressing various data samples into a condensed new data point. Based on two industrial case studies, both feasibility and effectiveness of the multi-rate data distillation strategy have been well evaluated and confirmed. Besides, it can be inferred that the requirement for the deep model complexity can be lowered with the introduction of the data distillation strategy, thus a relatively simpler model structure can obtain a satisfactory monitoring performance. This is actually of great significance in pursuing green artificial intelligence and lightweight deep learning models, particularly for those real-time industrial applications.","PeriodicalId":13341,"journal":{"name":"IEEE Transactions on Instrumentation and Measurement","volume":"74 ","pages":"1-10"},"PeriodicalIF":5.6000,"publicationDate":"2025-06-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Instrumentation and Measurement","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/11022759/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
The feature of multiple data sampling rates is among the most common natures in data-driven industrial process monitoring, which may have a significant impact on its performance, in terms of false alarm, monitoring sensitivity, computational complexity, and manpower resources. Instead of continuously polishing the model structure as usual, this article proposes a cumulative data distillation strategy under the deep monitoring framework. Without increasing the number of training samples, data distillation explores more effective information through compressing various data samples into a condensed new data point. Based on two industrial case studies, both feasibility and effectiveness of the multi-rate data distillation strategy have been well evaluated and confirmed. Besides, it can be inferred that the requirement for the deep model complexity can be lowered with the introduction of the data distillation strategy, thus a relatively simpler model structure can obtain a satisfactory monitoring performance. This is actually of great significance in pursuing green artificial intelligence and lightweight deep learning models, particularly for those real-time industrial applications.
期刊介绍:
Papers are sought that address innovative solutions to the development and use of electrical and electronic instruments and equipment to measure, monitor and/or record physical phenomena for the purpose of advancing measurement science, methods, functionality and applications. The scope of these papers may encompass: (1) theory, methodology, and practice of measurement; (2) design, development and evaluation of instrumentation and measurement systems and components used in generating, acquiring, conditioning and processing signals; (3) analysis, representation, display, and preservation of the information obtained from a set of measurements; and (4) scientific and technical support to establishment and maintenance of technical standards in the field of Instrumentation and Measurement.