The Cost Curve Nobody Budgeted For
Inference is cheap per call. Nobody modelled the number of calls.
By Tomas Alvarez
The pilot cost a rounding error. Production traffic was four hundred times the pilot, and the finance team noticed in month two.
Unit economics, revisited
The teams that stayed solvent cached aggressively, routed by difficulty, and measured cost per resolved case rather than cost per token.