Improving LBFGS Optimizer in PyTorch: Knowledge Transfer from Radio Interferometric Calibration to Machine Learning

Abstract

We have modified the LBFGS optimizer in PyTorch based on our knowledge in using the LBFGS algorithm in radio interferometric calibration (SAGECal). We give results to show the performance improvement of PyTorch in various machine learning applications due to our improvements.