Improving Cloud Service Resilience using Brownout-Aware Load-Balancing

Cristian Klein, Alessandro Vittorio Papadopoulos, Manfred Dellkrantz, Jonas Dürango, Martina Maggio, Karl-Erik Årzén, Francisco Hernàndez-Rodriguez, Erik Elmroth

Research output: Chapter in Book/Report/Conference proceedingPaper in conference proceedingpeer-review

23 Citations (SciVal)
1 Downloads (Pure)

Abstract

We focus on improving resilience of cloud services (e.g., e-commerce website), when correlated or cascading failures lead to computing capacity shortage. We study how to extend the classical cloud service architecture composed of a load-balancer and replicas with a recently proposed self-adaptive paradigm called brownout. Such services are able to reduce their capacity requirements by degrading user experience (e.g., disabling recommendations).
Combining resilience with the brownout paradigm is to date an open practical problem. The issue is to ensure that replica self-adaptivity would not confuse the load-balancing algorithm, overloading replicas that are already struggling with capacity shortage. For example, load-balancing strategies based on response times are not able to decide which replicas should be selected, since the response times are already controlled by the brownout paradigm.
In this paper we propose two novel brownout-aware load-balancing algorithms. To test their practical applicability, we extended the popular lighttpd web server and load-balancer, thus obtaining a production-ready implementation. Experimental evaluation shows that the approach enables cloud services to remain responsive despite cascading failures. Moreover, when compared to Shortest Queue First (SQF), believed to be near-optimal in the non-adaptive case, our algorithms improve user experience by 5%, with high statistical significance, while preserving response time predictability.
Original languageEnglish
Title of host publication[Host publication title missing]
PublisherIEEE - Institute of Electrical and Electronics Engineers Inc.
Pages31-40
Number of pages10
DOIs
Publication statusPublished - 2014
Event33rd IEEE International Symposium on Reliable Distributed Systems - Nara, Japan
Duration: 2014 Oct 7 → …

Conference

Conference33rd IEEE International Symposium on Reliable Distributed Systems
Country/TerritoryJapan
CityNara
Period2014/10/07 → …

Subject classification (UKÄ)

  • Control Engineering

Fingerprint

Dive into the research topics of 'Improving Cloud Service Resilience using Brownout-Aware Load-Balancing'. Together they form a unique fingerprint.

Cite this