Towards Performance Modeling of Speculative Execution for Cloud Applications

Research output: Chapter in Book/Report/Conference proceedingPaper in conference proceedingpeer-review

92 Downloads (Pure)

Abstract

Interesting approaches to counteract performance variability within cloud datacenters include sending multiple request clones, either immediately or after a specified waiting time. In this paper we present a performance model of cloud applications that utilize the latter concept, known as speculative execution. We study the popular Join-Shortest-Queue load-balancing strategy under the processor sharing queuing discipline. Utilizing the near-synchronized service property of this setting, we model speculative execution using a simplified synchronized service model. Our model is approximate, but accurate enough to be useful even for high utilization scenarios. Furthermore, the model is valid for any, possibly empirical, inter-arrival and service time distributions. We present preliminary simulation results, showing the promise of our proposed model.
Original languageEnglish
Title of host publicationACM/SPEC International Conference on Performance Engineering Companion (ICPE ’20 Companion)
Number of pages3
DOIs
Publication statusPublished - 2020
Event3rd Workshop on Hot Topics in Cloud Computing Performance - Edmonton, Canada
Duration: 2020 Apr 212020 Apr 21

Workshop

Workshop3rd Workshop on Hot Topics in Cloud Computing Performance
Country/TerritoryCanada
CityEdmonton
Period2020/04/212020/04/21

Subject classification (UKÄ)

  • Computer Systems

Keywords

  • Cloning
  • Speculative Execution
  • Cloud Computing
  • Datacenters

Fingerprint

Dive into the research topics of 'Towards Performance Modeling of Speculative Execution for Cloud Applications'. Together they form a unique fingerprint.

Cite this