Towards Performance Modeling of Speculative Execution for Cloud Applications

Research output: Chapter in Book/Report/Conference proceedingPaper in conference proceeding

Abstract

Interesting approaches to counteract performance variability within cloud datacenters include sending multiple request clones, either immediately or after a specified waiting time. In this paper we present a performance model of cloud applications that utilize the latter concept, known as speculative execution. We study the popular Join-Shortest-Queue load-balancing strategy under the processor sharing queuing discipline. Utilizing the near-synchronized service property of this setting, we model speculative execution using a simplified synchronized service model. Our model is approximate, but accurate enough to be useful even for high utilization scenarios. Furthermore, the model is valid for any, possibly empirical, inter-arrival and service time distributions. We present preliminary simulation results, showing the promise of our proposed model.

Details

Authors
Organisations
Research areas and keywords

Subject classification (UKÄ) – MANDATORY

  • Computer Systems

Keywords

  • Cloning, Speculative Execution, Cloud Computing, Datacenters
Original languageEnglish
Title of host publicationACM/SPEC International Conference on Performance Engineering Companion (ICPE ’20 Companion)
Number of pages3
Publication statusPublished - 2020
Publication categoryResearch
Peer-reviewedYes
Event3rd Workshop on Hot Topics in Cloud Computing Performance - Edmonton, Canada
Duration: 2020 Apr 212020 Apr 21

Workshop

Workshop3rd Workshop on Hot Topics in Cloud Computing Performance
CountryCanada
CityEdmonton
Period2020/04/212020/04/21

Total downloads

No data available

Related projects

View all (3)