Quantization Benchmarks: FP16 vs INT8 vs GPTQ vs AWQ — Which One Matters in Practice?

Or: How I Learned to Stop Worrying and Love Smaller Models