Federico Cerruto

Reducing LLM costs: personal hacks and production architecture

TL;DR: every token you send to an LLM has a cost. The strategies to reduce that cost look completely different depending on whether you’re…