Towards Performance Modeling of Speculative Execution for Cloud Applications

Research output: Chapter in Book/Report/Conference proceedingPaper in conference proceedingpeer-review

110 Downloads (Pure)


Interesting approaches to counteract performance variability within cloud datacenters include sending multiple request clones, either immediately or after a specified waiting time. In this paper we present a performance model of cloud applications that utilize the latter concept, known as speculative execution. We study the popular Join-Shortest-Queue load-balancing strategy under the processor sharing queuing discipline. Utilizing the near-synchronized service property of this setting, we model speculative execution using a simplified synchronized service model. Our model is approximate, but accurate enough to be useful even for high utilization scenarios. Furthermore, the model is valid for any, possibly empirical, inter-arrival and service time distributions. We present preliminary simulation results, showing the promise of our proposed model.
Original languageEnglish
Title of host publicationACM/SPEC International Conference on Performance Engineering Companion (ICPE ’20 Companion)
Number of pages3
Publication statusPublished - 2020
Event3rd Workshop on Hot Topics in Cloud Computing Performance - Edmonton, Canada
Duration: 2020 Apr 212020 Apr 21


Workshop3rd Workshop on Hot Topics in Cloud Computing Performance

Subject classification (UKÄ)

  • Computer Systems

Free keywords

  • Cloning
  • Speculative Execution
  • Cloud Computing
  • Datacenters


Dive into the research topics of 'Towards Performance Modeling of Speculative Execution for Cloud Applications'. Together they form a unique fingerprint.

Cite this