Improve Latency and Throughput with Weight-Activation Quantization in FP8

Quantization is a popular technique used to reduce the size of a machine learning model by lowering the numerical precision of some of its…