Speeding Up Large Language Models: A Deep Dive into GPTQ and AWQ Quantization

A Practical Guide to Reducing Model Size Without Sacrificing Performance