The next paper I’m going to read/write about is “ServiceRouter: Hyperscale and Minimal Cost Service Mesh at Meta”:
usenix.org/conference/osdi23…
The paper is unique in that it describes a system that supports several different ways of routing RPCs.
Alongside the “standard” proxy/sidecar-based implementations for routing RPCs, ServiceRouter also allows directly embedding routing functionality inside of an application binary, an approach that dramatically reduces cost!
The paper also talks about challenges of running an RPC routing system at hyper scale, and addresses how the system supports sharded services (discussed in my previous paper review on ShardManager,
micahlerner.com/2022/01/08/s…)