Optimization Methods For Large-Scale Machine Learning

Abstract

This paper mainly completes the binary classification of RCV1 text data set by logistic regression. Based on the established logistic regression model, the performance and characteristics of three numerical optimization algorithms–random gradient descent, Mini-Batch random gradient and L-BFGS are studied.