Introduction of Optimization Algorithm for Adaptive Gradient

Machine Learning is facing rapid development due to the almost unlimited amount of data available, and it is widely applied in diverse areas. Optimization is one of the core components in the machine learning which attracted more researcher's attention to it. In recent years there has been a great deal of work on improving optimisation methods in machine learning. In this paper we will introduce the Adaptive Gradient(Adapg), a new extension in the adaptive learning family Optimization algorithm.