Technical Note—On Adaptivity in Nonstationary Stochastic Optimization with Bandit Feedback

Abstract

Optimal Nonstationary Optimization Without Knowing Function Changes Nonstationary stochastic optimization plays a vital role in a number of computer science and operations research applications. It is known how to design and analyze algorithms that optimize a sequence of strongly convex/concave and smooth functions with access to only one-point noisy function values with the underlying function sequence subject to maximum magnitude of function changes. In recent work from Wang titled “Technical Note: On Adaptivity in Nonstationary Stochastic Optimization with Bandit Feedback,” an optimization algorithm is designed and analyzed without assuming the magnitude of function changes is known in advance. Optimality of the designed algorithm is demonstrated.