TY - GEN
T1 - Towards Performance Modeling of Speculative Execution for Cloud Applications
AU - Nylander, Tommi
AU - Ruuskanen, Johan
AU - Årzén, Karl-Erik
AU - Maggio, Martina
PY - 2020
Y1 - 2020
N2 - Interesting approaches to counteract performance variability within cloud datacenters include sending multiple request clones, either immediately or after a specified waiting time. In this paper we present a performance model of cloud applications that utilize the latter concept, known as speculative execution. We study the popular Join-Shortest-Queue load-balancing strategy under the processor sharing queuing discipline. Utilizing the near-synchronized service property of this setting, we model speculative execution using a simplified synchronized service model. Our model is approximate, but accurate enough to be useful even for high utilization scenarios. Furthermore, the model is valid for any, possibly empirical, inter-arrival and service time distributions. We present preliminary simulation results, showing the promise of our proposed model.
AB - Interesting approaches to counteract performance variability within cloud datacenters include sending multiple request clones, either immediately or after a specified waiting time. In this paper we present a performance model of cloud applications that utilize the latter concept, known as speculative execution. We study the popular Join-Shortest-Queue load-balancing strategy under the processor sharing queuing discipline. Utilizing the near-synchronized service property of this setting, we model speculative execution using a simplified synchronized service model. Our model is approximate, but accurate enough to be useful even for high utilization scenarios. Furthermore, the model is valid for any, possibly empirical, inter-arrival and service time distributions. We present preliminary simulation results, showing the promise of our proposed model.
KW - Cloning
KW - Speculative Execution
KW - Cloud Computing
KW - Datacenters
U2 - 10.1145/3375555.3384379
DO - 10.1145/3375555.3384379
M3 - Paper in conference proceeding
BT - ACM/SPEC International Conference on Performance Engineering Companion (ICPE ’20 Companion)
T2 - 3rd Workshop on Hot Topics in Cloud Computing Performance
Y2 - 21 April 2020 through 21 April 2020
ER -