MuMMI: multiple metrics modeling infrastructure for exploring performance and power modeling

MuMMI (Multiple Metrics Modeling Infrastructure) environment is an infrastructure that facilitates systematic measurement, modeling, and prediction of performance, power consumption and performance-power tradeoffs for parallel systems. MuMMI builds upon three existing frameworks: Prophesy for performance modeling and prediction of parallel applications, PAPI for hardware performance counter monitoring, and PowerPack for power measurement and profiling. In this paper, we present the MuMMI framework, which consists of an Instrumentor, Databases and Analyzer. The MuMMI Instrumentor provides automatic performance and power data collection and storage with low overhead. The MuMMI Databases extend the databases of Prophesy to store power and energy consumption and hardware performance counters' data with different CPU frequency settings. The MuMMI Analyzer extends the data analysis component of Prophesy to support power consumption and hardware performance counters, and it entails performance and power modeling, performance-power tradeoff and optimizations, and web-based automated modeling system. Currently, our MuMMI online automated performance and power modeling system uses four modeling techniques: curve fitting, parameterization, kernel coupling and performance-counters-based, we discuss the effort to automate the process of developing performance and power models for scientific applications online, and focus on exploring performance-counters-based performance and power modeling. The MuMMI environment is able to aid in performance and power data measurement, storage, modeling and prediction of scientific applications on XSEDE resources in XSEDE community.