Optimizing feedforward neural networks using a modified weighted mean of vectors: Case study chemical datasets

Abstract

This paper proposes a modified version of the weighted mean of vectors algorithm (mINFO), which combines the strengths of the INFO algorithm with the Enhanced Solution Quality Operator (ESQ). The ESQ boosts the quality of the solutions by avoiding optimal local values, verifying that each solution moves towards a better position, and increasing the convergence speed. Furthermore, we employ the mINFO algorithm to optimize the connection weights and biases of feedforward neural networks (FNNs) to improve their accuracy. The efficacy of FNNs for classification tasks is mainly dependent on hyperparameter tuning, such as the number of layers and nodes. The mINFO was evaluated using the IEEE Congress on Evolutionary Computation held in 2020 (CEC’2020) for optimization tests, and ten chemical data sets were applied to validate the performance of the FNNs classifier. The proposed algorithm’s results have been evaluated with those of other well-known optimization methods, including Runge Kutta optimizer’s (RUN), particle swarm optimization (PSO), grey wolf optimization (GWO), Harris hawks optimization (HHO), whale optimization algorithm (WOA), slime mould algorithm (SMA) and the standard weighted mean of vectors (INFO). In addition, some improved metaheuristic algorithms. The experimental results indicate that the proposed mINFO algorithm can improve the convergence speed and generate effective search results without increasing computational costs. In addition, it has improved the FNN’s classification efficiency.