FSDP vs DeepSpeed

Romeo Kienzler in collaboration with Mark Sosman— IBM Research & ETH Zürich