{"title":"多注意力关键因子感知卷积神经网络用于处理不同频率采样数据的批处理质量预测","authors":"Yufeng Dong, Xuefeng Yan","doi":"10.1002/cjce.25695","DOIUrl":null,"url":null,"abstract":"<p>Quality prediction is a critical issue in batch processes, where it encounters numerous challenges. Actual batch processes exhibit characteristics of multiple sampling frequencies and multiple stages. The former influences the efficient utilization of data, while the latter typically corresponds to sequential microbial growth stages or operational steps, manifesting as complex process dynamics that affect the effective extraction of process features. This paper presents a multi-attention key-factor-aware convolutional neural network (MKCNN) designed to address both aspects. MKCNN is a multi-branch model, with each branch receiving data sampled at a different frequency as input. Two types of branches are designed: Main Branch and Auxiliary Branch. The former tackles data containing process stage characteristics and local dynamics. In this branch, spatial attention enhances stage-specific features, while channel attention emphasizes the overall local dynamics. The latter handles data covering local dynamics or overall static features. In this branch, either spatial attention enhances local dynamics, or channel attention emphasizes overall static features. Subsequently, features from each branch are fused by a feature decomposition and fusion module (FDFM). FDFM employs cross-attention to capture the correlation among the features from different branches. The proposed MKCNN was evaluated on a real-world ethanol fermentation process (EFP) against support vector regression (SVR), multi-branch convolutional neural network (MCNN), and multi-branch long short-term memory (MLSTM), and so forth. MKCNN demonstrated an average improvement of 11.7% in <i>R</i><sup>2</sup> compared to SVR and a 5.7% improvement compared to MLSTM. These results underscore its superior performance in quality prediction.</p>","PeriodicalId":9400,"journal":{"name":"Canadian Journal of Chemical Engineering","volume":"103 11","pages":"5231-5248"},"PeriodicalIF":1.9000,"publicationDate":"2025-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Multi-attention key-factor-aware convolutional neural network developed for quality prediction of batch processes tackling data sampled at various frequencies\",\"authors\":\"Yufeng Dong, Xuefeng Yan\",\"doi\":\"10.1002/cjce.25695\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Quality prediction is a critical issue in batch processes, where it encounters numerous challenges. Actual batch processes exhibit characteristics of multiple sampling frequencies and multiple stages. The former influences the efficient utilization of data, while the latter typically corresponds to sequential microbial growth stages or operational steps, manifesting as complex process dynamics that affect the effective extraction of process features. This paper presents a multi-attention key-factor-aware convolutional neural network (MKCNN) designed to address both aspects. MKCNN is a multi-branch model, with each branch receiving data sampled at a different frequency as input. Two types of branches are designed: Main Branch and Auxiliary Branch. The former tackles data containing process stage characteristics and local dynamics. In this branch, spatial attention enhances stage-specific features, while channel attention emphasizes the overall local dynamics. The latter handles data covering local dynamics or overall static features. In this branch, either spatial attention enhances local dynamics, or channel attention emphasizes overall static features. Subsequently, features from each branch are fused by a feature decomposition and fusion module (FDFM). FDFM employs cross-attention to capture the correlation among the features from different branches. The proposed MKCNN was evaluated on a real-world ethanol fermentation process (EFP) against support vector regression (SVR), multi-branch convolutional neural network (MCNN), and multi-branch long short-term memory (MLSTM), and so forth. MKCNN demonstrated an average improvement of 11.7% in <i>R</i><sup>2</sup> compared to SVR and a 5.7% improvement compared to MLSTM. These results underscore its superior performance in quality prediction.</p>\",\"PeriodicalId\":9400,\"journal\":{\"name\":\"Canadian Journal of Chemical Engineering\",\"volume\":\"103 11\",\"pages\":\"5231-5248\"},\"PeriodicalIF\":1.9000,\"publicationDate\":\"2025-04-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Canadian Journal of Chemical Engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/cjce.25695\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, CHEMICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Canadian Journal of Chemical Engineering","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/cjce.25695","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, CHEMICAL","Score":null,"Total":0}
Multi-attention key-factor-aware convolutional neural network developed for quality prediction of batch processes tackling data sampled at various frequencies
Quality prediction is a critical issue in batch processes, where it encounters numerous challenges. Actual batch processes exhibit characteristics of multiple sampling frequencies and multiple stages. The former influences the efficient utilization of data, while the latter typically corresponds to sequential microbial growth stages or operational steps, manifesting as complex process dynamics that affect the effective extraction of process features. This paper presents a multi-attention key-factor-aware convolutional neural network (MKCNN) designed to address both aspects. MKCNN is a multi-branch model, with each branch receiving data sampled at a different frequency as input. Two types of branches are designed: Main Branch and Auxiliary Branch. The former tackles data containing process stage characteristics and local dynamics. In this branch, spatial attention enhances stage-specific features, while channel attention emphasizes the overall local dynamics. The latter handles data covering local dynamics or overall static features. In this branch, either spatial attention enhances local dynamics, or channel attention emphasizes overall static features. Subsequently, features from each branch are fused by a feature decomposition and fusion module (FDFM). FDFM employs cross-attention to capture the correlation among the features from different branches. The proposed MKCNN was evaluated on a real-world ethanol fermentation process (EFP) against support vector regression (SVR), multi-branch convolutional neural network (MCNN), and multi-branch long short-term memory (MLSTM), and so forth. MKCNN demonstrated an average improvement of 11.7% in R2 compared to SVR and a 5.7% improvement compared to MLSTM. These results underscore its superior performance in quality prediction.
期刊介绍:
The Canadian Journal of Chemical Engineering (CJChE) publishes original research articles, new theoretical interpretation or experimental findings and critical reviews in the science or industrial practice of chemical and biochemical processes. Preference is given to papers having a clearly indicated scope and applicability in any of the following areas: Fluid mechanics, heat and mass transfer, multiphase flows, separations processes, thermodynamics, process systems engineering, reactors and reaction kinetics, catalysis, interfacial phenomena, electrochemical phenomena, bioengineering, minerals processing and natural products and environmental and energy engineering. Papers that merely describe or present a conventional or routine analysis of existing processes will not be considered.