On the population least‐squares criterion in the monotone single index model

Abstract

Monotone single index models have gained increasing popularity over the past decades due to their flexibility and versatile use in diverse areas. Semi‐parametric estimators such as the least squares and maximum likelihood estimators of the unknown index and monotone ridge function were considered to make inference in such models without having to choose some tuning parameter. Description of the asymptotic behavior of those estimators crucially depends on acquiring a good understanding of the optimization problems associated with the corresponding population criteria. In this paper, we give several insights into these criteria by proving existence of minimizers thereof over general classes of parameters. In order to describe these minimizers, we prove different results which give the direction of variation of the population criteria in general and in the special case where the common distribution of the covariates is Gaussian. A complementary simulation study was performed and whose results give support to our main theorems.