Distributed Inference

How you actually serve a trained model to thousands of concurrent users.