Accelerating Checkpoint I/O: Disaggregated Memory and Tiered Storage for Large-Scale Training…

Abstract: When a hardware failure interrupts large-scale distributed training, the time to recover is dominated by a single bottleneck…