Wasted Words, Wasted Watts: Babbling and the Avoidable Energy Cost in LLM Code Generation
Large Language Models (LLMs) are now widely used in modern software development, assisting developers in generating, testing and maintaining code. However, even when an LLM produces a correct solution, it often continues to generate tokens that do not contribute to it, such as duplicate implementations, usage examples,...