Multidimensional Cluster Sampling View on Large Databases for Approximate Query Processing

Abstract

Approximate query processing with relatively small random samples is an effective way to deal with many queries on large databases. However, small random samples might miss relevant records for highly selective queries due to insufficient coverage. A multidimensional index tree called the k-MDI was proposed as an effective sampling scheme for highly selective decision support queries. It has been shown to support a fast response time and high accuracy, whereas implementation of the k-MDI on database tables was not discussed. This paper proposes the Multidimensional Cluster Sampling View based on the k-MDI. The view can be implemented with ease using common database tables and can be manipulated by SQL statements. Furthermore, it is able to provide trustable approximate answers quickly for any query condition. The response time and accuracy of approximation are validated on a large dataset based on TPC-DS specifications.