How Long Does an iPhone Take to Process 1 Billion Tokens?

ZeroGPU turns unused compute on everyday devices into a distributed inference grid. The goal is to make small model inference cheap and…