QuintNet — A 3D distributed Training Library

Ever wondered how companies train GPT-4, Llama, or Claude across thousands of GPUs?