TPC-H benchmarking of Pig Latin on a Hadoop cluster

Abstract

Several companies report success stories after migration from relational database management systems to NoSQL systems (Not only SQL). The latter seem to take over in most data storage fields. These technologies must be used properly, and businesses must be aware of the limitations of NoSQL, for providing real benefits. Pig Latin is a high-level language for expressing data analysis programs, and implementing the MapReduce framework on top of Hadoop Distributed File System. This paper benchmarks Pig Latin using the well known TPC-H benchmark -a Decision Support System benchmark, and reports performance results for different settings on GRID5000 clusters.