Dynamic latency control of serverless applications operated on AWS lambda and greengrass

Abstract

Cloud native programming and the serverless paradigm can revolutionize software development and the operation of distributed applications. However, latency sensitive applications pose additional challenges to the underlying networks and cloud platforms. Moving compute resources to the edge is an inevitable step but further mechanisms and novel components are also required to enable such services in a serverless environment. In this demonstration, we present a novel system providing soft latency control for serverless applications and we showcase our proof-of-concept prototype supervising microservices operated on Amazon Web Services, and its edge extension, called Greengrass. Our main objective is the cost optimal operation while meeting the average latency requirements which is achieved by dynamically changing the software layout and serverless artifacts based on live monitoring.