inference optimization

The 150x model tax

Cost, latency, and quality trade against each other in LLM inference. How to route work, use serving-layer levers, and architect systems on the efficient frontier.