Luminance Simulation in CARLA under Cloud Coverage - Model Validation and Implications

Abstract

To decrease the number of kilometers driven during the development of autonomous cars or driving assistance systems, performant simulation tools are necessary. Currently, domain distance effects between simulation and reality are limiting the successful application of rendering engines in data-driven perception tasks. In order to mitigate those domain distance effects, simulation tools have to be as close to reality as possible for the given task. For optical sensors like cameras, the luminance of the scene is essential. We provide within this paper a method to measure the luminance of rendered scenes within CARLA, an often used open-source simulation environment. Thereby, it is possible to validate the environment and weather models by taking real-world measurements with photometric sensors or with the help of open-source weather data, published e.g. by the German federal service for weather data (DWD - "Deutscher Wetterdienst"). Employing our proposed luminance measurement, the domain gap resulting from the simulation can be specified, which makes it possible to evaluate the statements about the safety of the automated driving system determined within the simulation. We show that the ratio between global and diffuse radiation modeled by the default atmosphere models within CARLA are under limited conditions similar to real-world measurements taken by the DWD. Nevertheless, we show, that the ratio’s temporal variability in real-world situations is not modeled by CARLA.