Weak Decoupling, Polynomial Folds and Approximate Optimization over the Sphere

Abstract

We consider the following basic problem: given an n-variate degree-d homogeneous polynomial f with real coefficients, compute a unit vector x in R{\string^}n that maximizes abs(f(x)). Besides its fundamental nature, this problem arises in diverse contexts ranging from tensor and operator norms to graph expansion to quantum information theory. The homogeneous degree-2 case is efficiently solvable as it corresponds to computing the spectral norm of an associated matrix, but the higher degree case is NP-hard.We give approximation algorithms for this problem that offer a trade-off between the approximation ratio and running time: in n{\string^}O(q) time, we get an approximation within factor (O(n)\,/\,q){\string^}(d/2-1) for arbitrary polynomials, (O(n)\,/\,q){\string^}(d/4-1/2) for polynomials with non-negative coefficients, and (m\,/\,q){\string^}(1/2) for sparse polynomials with m monomials. The approximation guarantees are with respect to the optimum of the level-q sum-of-squares (SoS) SDP relaxation of the problem (though our algorithms do not rely on actually solving the SDP). Known polynomial time algorithms for this problem rely on decoupling lemmas. Such tools are not capable of offering a trade-off like our results as they blow up the number of variables by a factor equal to the degree. We develop new decoupling tools that are more efficient in the number of variables at the expense of less structure in the output polynomials. This enables us to harness the benefits of higher level SoS relaxations. Our decoupling methods also work with folded polynomials, which are polynomials with polynomials as coefficients. This allows us to exploit easy substructures (such as quadratics) by considering them as coefficients in our algorithms. %We complement our algorithmic results with some polynomially large integrality gaps for d-levels of the SoS relaxation. For general polynomials this follows from known results for random polynomials, which yield a gap of Ω(n){\string^}(d/4-1/2). For polynomials with non-negative coefficients, we prove an Ω(n{\string^}(1/6)\,/\, polylogs) gap for the degree-4 case, based on a novel distribution of 4-uniform hypergraphs. We establish an n{\string^}Ω(d) gap for general degree-d, albeit for a slightly weaker (but still very natural) relaxation. Toward this, we give a method to lift a level-4 solution matrix M to a higher level solution, under a mild technical condition on M.From a structural perspective, our work yields worst-case convergence results on the performance of the sum-of-squares hierarchy for polynomial optimization. Despite the popularity of SoS in this context, such results were previously only known for the case of q = Omega(n).