Stream-oriented Availability Services for Endpoint-to-endpoint Data Transmission

Abstract

Continuous real-time data stream show its significance in many applications under Cloud computing. Traditional high availability mechanism for data stream processing systems is dedicated and tightly coupled, and brings difficulties on maintenance or extension if requirements change. In this paper, basic endpoint-to-endpoint transmission is separated as general services from particular systems to independently provide no-loss guarantee of upstream data, through which high level extended HA mechanism can be realized conveniently. Comprehensive experiments illustrate that the overhead of the services is quite small and the tradeoff between guarantee and overheads is acceptable.