Forecasting the spatial spread of an Ebola epidemic in real time: Comparing predictions of mathematical models and experts.

Abstract

Background: Ebola virus disease outbreaks can often be controlled, but require rapid response efforts frequently with profound operational complexities. Mathematical models can be used to support response planning, but it is unclear if models improve the prior understanding of experts.

Methods: We performed repeated surveys of Ebola response experts during an outbreak. From each expert, we elicited the probability of cases exceeding four thresholds between 2 and 20 cases in a set of small geographical areas in the following calendar month. We compared the predictive performance of these forecasts to those of two mathematical models with different spatial interaction components.

Results: An ensemble combining the forecasts of all experts performed similarly to the two models. Experts showed stronger bias than models forecasting two-case threshold exceedance. Experts and models both performed better when predicting exceedance of higher thresholds. The models also tended to be better at risk-ranking areas than experts.

Conclusions: Our results support the use of models in outbreak contexts, offering a convenient and scalable route to a quantified situational awareness, which can provide confidence in or to call into question existing advice of experts. There could be value in combining expert opinion and modelled forecasts to support the response to future outbreaks.

Funding: This study was partly funded by the Department of Health and Social Care using UK Aid funding 47 and is managed by the National Institute for Health and Care Research (VEEPED: PR-OD-1017- 48 20002; AR and WJE). This study was partly funded by the Wellcome Trust (210758/Z/18/Z : JDM 49 and SF). The views expressed in this publication are those of the authors and not necessarily 50 those of the funders.