How Quantization and Distillation Are Putting Real AI on Your Phone

Running a capable language model offline used to require a server rack. Now it needs a Raspberry Pi. Two techniques made this possible —…