Modular: Why LLM Inference Needs a New Kind of Router - Part 3
Most routing stacks ship with a fixed set of algorithms: round-robin, least-requests, consistent hashing, etc. These are generally independent implementations rather than composable components. As a...
modular.com