FP8 Quantization for Large Model Training: Performance Optimization and Analysis

Background & TL;DR