Pricing Time, Not Just Tokens: Latency-Aware Mechanism Design for LLM Inference
The economic theory of LLM pricing treats tokens as a homogeneous commodity considering aggregate token count as the main features buyers and sellers consider. We model inference as a service market where buyers have three-dimensional private information - willingness-to-pay, task volume, and time preference - and util...