Zhen Wang , Sung-Kwun Oh , Zunwei Fu , Seok-Beom Roh , Witold Pedrycz
{"title":"利用dropfilter和对偶统计选择实现了基于动态多重多项式的神经网络分类器","authors":"Zhen Wang , Sung-Kwun Oh , Zunwei Fu , Seok-Beom Roh , Witold Pedrycz","doi":"10.1016/j.engappai.2025.111164","DOIUrl":null,"url":null,"abstract":"<div><div>Polynomial neural networks (PNN) have emerged as an effective regression modeling methodology in computational intelligence, relying on its interpretable polynomial nodes to fit complex nonlinear data relationships and the adaptive nature of self-organizing networks. To break the bottleneck of PNN structure in the field of multi-classification, this study designs a dynamical multiple polynomial-based neural networks (DMPNN) classifier, focusing on developing a flexible polynomial network classification methodology that enhances predictive capabilities without sacrificing the advantages of PNN structures. Our approach effectively addresses the challenges of multi-class classification with uncertain class boundaries and reduces computational complexity, which is achieved through the synergy of several proposed techniques. Three key issues underpin the proposed DMPNN: (a) The integration of PNN regression models using the one-against-all strategy can provide effective and scalable solutions to multi-class classification problems, especially for uncertain class boundary issues. (b) The dual statistical selection (DSS) approach aims to eliminate redundant inputs during data processing, reduce the computational burden, and increase the variety of neural network nodes in the model neuron selection stage. (c) The synergy of regularization methods including the ℓ2 norm-based method (ℓ2-LSM) and the DropFilter, is exploited to mitigate potential overfitting in coefficient estimation and enhance the generalization capabilities of the proposed classifier. A series of ablation experiments and parameter analysis were conducted to demonstrate the stability and reliability of the proposed model. Then, we applied DMPNN to 17 publicly available datasets and two engineering applications: Recycling of black plastic wastes and phased resolved partial discharge. The performance results show that the DMPNN model outperforms five classical classifiers and four state-of-the-art (SOTA) classifiers on 78.94% of the datasets. This highlights the unique ability of the proposed DMPNN to enhance predictive accuracy while maintaining model simplicity and interpretability.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"157 ","pages":"Article 111164"},"PeriodicalIF":8.0000,"publicationDate":"2025-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Dynamical multiple polynomial-based neural networks classifier realized with the aid of dropfilter and dual statistical selection\",\"authors\":\"Zhen Wang , Sung-Kwun Oh , Zunwei Fu , Seok-Beom Roh , Witold Pedrycz\",\"doi\":\"10.1016/j.engappai.2025.111164\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Polynomial neural networks (PNN) have emerged as an effective regression modeling methodology in computational intelligence, relying on its interpretable polynomial nodes to fit complex nonlinear data relationships and the adaptive nature of self-organizing networks. To break the bottleneck of PNN structure in the field of multi-classification, this study designs a dynamical multiple polynomial-based neural networks (DMPNN) classifier, focusing on developing a flexible polynomial network classification methodology that enhances predictive capabilities without sacrificing the advantages of PNN structures. Our approach effectively addresses the challenges of multi-class classification with uncertain class boundaries and reduces computational complexity, which is achieved through the synergy of several proposed techniques. Three key issues underpin the proposed DMPNN: (a) The integration of PNN regression models using the one-against-all strategy can provide effective and scalable solutions to multi-class classification problems, especially for uncertain class boundary issues. (b) The dual statistical selection (DSS) approach aims to eliminate redundant inputs during data processing, reduce the computational burden, and increase the variety of neural network nodes in the model neuron selection stage. (c) The synergy of regularization methods including the ℓ2 norm-based method (ℓ2-LSM) and the DropFilter, is exploited to mitigate potential overfitting in coefficient estimation and enhance the generalization capabilities of the proposed classifier. A series of ablation experiments and parameter analysis were conducted to demonstrate the stability and reliability of the proposed model. Then, we applied DMPNN to 17 publicly available datasets and two engineering applications: Recycling of black plastic wastes and phased resolved partial discharge. The performance results show that the DMPNN model outperforms five classical classifiers and four state-of-the-art (SOTA) classifiers on 78.94% of the datasets. This highlights the unique ability of the proposed DMPNN to enhance predictive accuracy while maintaining model simplicity and interpretability.</div></div>\",\"PeriodicalId\":50523,\"journal\":{\"name\":\"Engineering Applications of Artificial Intelligence\",\"volume\":\"157 \",\"pages\":\"Article 111164\"},\"PeriodicalIF\":8.0000,\"publicationDate\":\"2025-06-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Engineering Applications of Artificial Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0952197625011650\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197625011650","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Dynamical multiple polynomial-based neural networks classifier realized with the aid of dropfilter and dual statistical selection
Polynomial neural networks (PNN) have emerged as an effective regression modeling methodology in computational intelligence, relying on its interpretable polynomial nodes to fit complex nonlinear data relationships and the adaptive nature of self-organizing networks. To break the bottleneck of PNN structure in the field of multi-classification, this study designs a dynamical multiple polynomial-based neural networks (DMPNN) classifier, focusing on developing a flexible polynomial network classification methodology that enhances predictive capabilities without sacrificing the advantages of PNN structures. Our approach effectively addresses the challenges of multi-class classification with uncertain class boundaries and reduces computational complexity, which is achieved through the synergy of several proposed techniques. Three key issues underpin the proposed DMPNN: (a) The integration of PNN regression models using the one-against-all strategy can provide effective and scalable solutions to multi-class classification problems, especially for uncertain class boundary issues. (b) The dual statistical selection (DSS) approach aims to eliminate redundant inputs during data processing, reduce the computational burden, and increase the variety of neural network nodes in the model neuron selection stage. (c) The synergy of regularization methods including the ℓ2 norm-based method (ℓ2-LSM) and the DropFilter, is exploited to mitigate potential overfitting in coefficient estimation and enhance the generalization capabilities of the proposed classifier. A series of ablation experiments and parameter analysis were conducted to demonstrate the stability and reliability of the proposed model. Then, we applied DMPNN to 17 publicly available datasets and two engineering applications: Recycling of black plastic wastes and phased resolved partial discharge. The performance results show that the DMPNN model outperforms five classical classifiers and four state-of-the-art (SOTA) classifiers on 78.94% of the datasets. This highlights the unique ability of the proposed DMPNN to enhance predictive accuracy while maintaining model simplicity and interpretability.
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.