Big Data and Official Statistics

Abstract

Over recent years, the potential of big data for government, for business, for society has excited much comment, debate, and even evangelism. But are big data really the panacea to all our data problems or is this just hype and hubris? This is the question facing official statisticians: Are big data worth the investment of time and resources? While the statistical possibilities appear endless, big data also present enormous challenges and potential pitfalls: legal, ethical, technical, and reputational. This chapter examines the opportunities and challenges presented by big data and also discusses some governance issues arising for official statistics.