Performance Mimicking Benchmarks for Multi-tier Applications

Abstract

Predicting performance of multi-tier enterprise applications for a target platform is of significant importance to IT industries especially when target environment is unavailable for deployment. Performance modeling techniques depend on accurate estimation of resource demands for a specific application. This paper proposes a methodology for deriving Performance Mimicking Benchmarks (PMBs) that can predict resource demand of application server of multi-tier on-line transaction processing applications on a target environment. PMBs do not require the actual application to be deployed on the target itself. These benchmarks invoke similar method calls as the application at different layers in the technology stack that contribute significantly to CPU utilization. Further, they mimic all send and receive interactions with external servers (e.g., database server) and web clients. Ability of PMBs for service demand prediction is validated with a number of sample multi-tier applications including SPECjEnterprise2010 on disparate hardware configurations. These service demands when used in a modified version of Mean Value Analysis algorithm, can predict throughput and response time with accuracy close to 90%.