Dynamical multiple polynomial-based neural networks classifier realized with the aid of dropfilter and dual statistical selection

Abstract

Polynomial neural networks (PNN) have emerged as an effective regression modeling methodology in computational intelligence, relying on its interpretable polynomial nodes to fit complex nonlinear data relationships and the adaptive nature of self-organizing networks. To break the bottleneck of PNN structure in the field of multi-classification, this study designs a dynamical multiple polynomial-based neural networks (DMPNN) classifier, focusing on developing a flexible polynomial network classification methodology that enhances predictive capabilities without sacrificing the advantages of PNN structures. Our approach effectively addresses the challenges of multi-class classification with uncertain class boundaries and reduces computational complexity, which is achieved through the synergy of several proposed techniques. Three key issues underpin the proposed DMPNN: (a) The integration of PNN regression models using the one-against-all strategy can provide effective and scalable solutions to multi-class classification problems, especially for uncertain class boundary issues. (b) The dual statistical selection (DSS) approach aims to eliminate redundant inputs during data processing, reduce the computational burden, and increase the variety of neural network nodes in the model neuron selection stage. (c) The synergy of regularization methods including the ℓ2 norm-based method (ℓ2-LSM) and the DropFilter, is exploited to mitigate potential overfitting in coefficient estimation and enhance the generalization capabilities of the proposed classifier. A series of ablation experiments and parameter analysis were conducted to demonstrate the stability and reliability of the proposed model. Then, we applied DMPNN to 17 publicly available datasets and two engineering applications: Recycling of black plastic wastes and phased resolved partial discharge. The performance results show that the DMPNN model outperforms five classical classifiers and four state-of-the-art (SOTA) classifiers on 78.94% of the datasets. This highlights the unique ability of the proposed DMPNN to enhance predictive accuracy while maintaining model simplicity and interpretability.