Response Time Based Balancing of Load in Web Server Clusters

Abstract

In this paper, a load balancing framework is presented which allows user requests to be dynamically distributed among clustered back-end web servers based on the response time to achieve efficient load balancing of the system. In this proposed approach, load balancer runs on jetty web server which is a light weight server and easy to embed in java. Request will come from browser or SoapUI (for bulk messages). A track of requests and response on each server is maintained in hash map data structure. Whenever a new request comes in, it will be distributed among web servers based on response time and pending jobs on that server.The performance and comparisons of proposed algorithm is demonstrated through various experimental results and graphs.