Deploying DistilBERT on Kubernetes

What I Learned About Resource Limits and Inference Latency