New hybrid algorithm based on nonmonotone spectral gradient and simultaneous perturbation

Abstract

In this paper, we introduce a new hybrid method called nonmonotone spectral gradient and simultaneous perturbation (NSGSP). It combines the advantages of nonmonotone spectral gradient (NSG), and simultaneous perturbation (SP) methods. The main idea of our approach is to use the simultaneous perturbation (SP) method in order to get a non expensive estimate of the gradient, and exploit the good properties of the nonmonotone spectral gradient (NSG) method in order to compute an efficient line search. Several numerical experiments are provided. The results indicate that the new method is effective and outperforms most of other popular methods.