Transformer from scratch with Jax and Flax - Part 1

The full code is available on Github.