RTX 5080 LLM Power Efficiency: Measured Watts and Joules per Token
Measured board power, tokens per joule, and electricity cost per million tokens for local large language model inference on a retail NVIDIA RTX 5080. Board power was logged with nvidia-smi at 1 Hz while driving fixed-length generations. Efficiency. Llama 3.2 3B 1.20 tokens/joule; sparse gpt-oss 20B 0.665; Qwen 2.5 7B 0...