Compressing Gemma 4 12B with LLM Compressor and Serving It on vLLM

This is the full journey of taking Gemma 4 12B from a 23.9GB BF16 model to a 15GB FP8 one that serves on a single GPU — start to finish…