Should We Use FP16 Instead of FP32 in Production?

When we build an ML model, we usually start with FP32. It is safe, stable, and gives us good precision. But when it is time to move the…