Optical measurement with foveated rendering and dynamic compensation in eye-tracking near-eye displays

Abstract

Eye-tracking technology has been widely adopted in the extended reality (XR) industry, particularly in applications such as foveated rendering, eye-tracking interactions, and optical algorithm compensation, enhancing user immersion and providing smooth virtual experiences. For near-eye display systems integrated with eye-tracking capabilities, optical performance metrics such as the contrast transfer function (CTF), distortion, chromaticity uniformity (CU), and chromatic aberration (CA) vary with shifts in the user's fixation point, rendering traditional measurement methods inadequate for such systems. To address this, this paper proposes a novel approach for measuring CTF based on foveated rendering, as well as a dynamic compensation-based method for assessing distortion, CU and CA in eye-tracking near-eye display systems. Experiments are conducted to measure the CTF under both eye-tracked foveated rendering (ETFR) and fixed foveated rendering (FFR). The results demonstrate that the CTF under ETFR is higher than that under FFR, more accurately reflecting the image clarity perceived by the human eye. Additionally, CU shows marked improvement after compensation, with a noticeable reduction in green color shift. The average $∆u^{\prime }{v}^{\prime }$ decreases from 0.0092 to 0.0042, suggesting improved CU. Moreover, dynamic distortion is effectively mitigated after compensation. However, CA exhibited no significant improvement after compensation.