MiniGPT in JAX: 3D Parallelism for Scalable Transformer Training

Part 1: Single node — Multi GPU