An asymptotic orthogonality relation for GL(n, ℝ)

Abstract

Orthogonality is a fundamental theme in representation theory and Fourier analysis. An orthogonality relation for characters of finite abelian groups (now recognized as an orthogonality relation on $\mathrm{GL}<!--FUNCTION\; APPLICATION-->(1)$) was used by Dirichlet to prove infinitely many primes in arithmetic progressions. Asymptotic orthogonality relations for $\mathrm{GL}<!--FUNCTION\; APPLICATION-->(n)$, with $n\le 3$, and applications to number theory, have been considered by various researchers over the last 45 years. Recently, the authors of the present work have derived an explicit asymptotic orthogonality relation, with a power savings error term, for $\mathrm{GL}<!--FUNCTION\; APPLICATION-->(4,ℝ)$. Here we extend those results to $\mathrm{GL}<!--FUNCTION\; APPLICATION-->(n,ℝ)$, $n\ge 2$.

For $n\le 5$, our results are contingent on the Ramanujan conjecture at the infinite place, but otherwise are unconditional. In particular, the case $n=5$ represents a new result. The key new ingredient for the proof of the case $n=5$ is the theorem of Kim and Shahidi that functorial products of cusp forms on $\mathrm{GL}<!--FUNCTION\; APPLICATION-->(2)\times \mathrm{GL}<!--FUNCTION\; APPLICATION-->(3)$ are automorphic on $\mathrm{GL}<!--FUNCTION\; APPLICATION-->(6)$. For $n>5$ (assuming again the Ramanujan conjecture holds at the infinite place), our results are conditional on two conjectures, both of which have been verified in various special cases. The first of these conjectures regards lower bounds for Rankin–Selberg L-functions, and the second concerns recurrence relations for Mellin transforms of $\mathrm{GL}<!--FUNCTION\; APPLICATION-->(n,ℝ)$ Whittaker functions.

Central to our proof is an application of the Kuznetsov trace formula, and a detailed analysis, utilizing a number of novel techniques, of the various entities — Hecke–Maass cusp forms, Langlands Eisenstein series, spherical principal series Whittaker functions and their Mellin transforms, and so on — that arise in this application.