Transformer from Scratch with JAX and Flax — Part 3: FSDP Training

The full code is available on Github.