Adaptive and Application-agnostic Caching in Service Meshes for Resilient Cloud Applications

Lars Larsson, William Tärneberg, Cristian Klein, Maria Kihl, Erik Elmroth

Research output: Chapter in Book/Report/Conference proceedingPaper in conference proceedingpeer-review

122 Downloads (Pure)


Service meshes factor out code dealing with inter-micro-service communication. The overall resilience of a cloud application is improved if constituent micro-services return stale data, instead of no data at all. This paper proposes and implements application agnostic caching for micro services. While caching is widely employed for serving web service traffic, its usage in inter-micro-service communication is lacking. Micro-services responses are highly dynamic, which requires carefully choosing adaptive time-to-life caching algorithms. Our approach is application agnostic, is cloud native, and supports gRPC. We evaluate our approach and implementation using the micro-service benchmark by Google Cloud called Hipster Shop. Our approach results in caching of about 80% of requests. Results show the feasibility and efficiency of our approach, which encourages implementing caching in service meshes. Additionally, we make the code, experiments, and data publicly available.

Original languageEnglish
Title of host publicationProceedings of the 2021 IEEE Conference on Network Softwarization (NetSoft)
Subtitle of host publicationAccelerating Network Softwarization in the Cognitive Age
EditorsKohei Shiomoto, Young-Tak Kim, Christian Esteve Rothenberg, Barbara Martini, Eiji Oki, Baek-Young Choi, Noriaki Kamiyama, Stefano Secci
PublisherIEEE - Institute of Electrical and Electronics Engineers Inc.
Number of pages5
ISBN (Electronic)9781665405225
Publication statusPublished - 2021 Jun 28
Event7th IEEE International Conference on Network Softwarization, NetSoft 2021 - Virtual, Online
Duration: 2021 Jun 282021 Jul 2


Conference7th IEEE International Conference on Network Softwarization, NetSoft 2021
CityVirtual, Online

Subject classification (UKÄ)

  • Electrical Engineering, Electronic Engineering, Information Engineering

Free keywords

  • Containerized network functions
  • Microservices
  • Service-mesh


Dive into the research topics of 'Adaptive and Application-agnostic Caching in Service Meshes for Resilient Cloud Applications'. Together they form a unique fingerprint.

Cite this