Part 2 — The Router

Series: Building an LLM Playground Farm. See Part 0 for the architecture and Part 1 for the inference backend.