Kuberay Batch Inference

What I learned running large-scale batch LLM inference on Kubernetes with KubeRay + Qwen
When I started this project, I assumed batch…