Say Less, Mean Better: Training-Free Verbosity Control for Language Models
Large language models (LLMs) often generate responses longer than necessary, increasing inference latency and computational cost. While prompting can encourage conciseness, controlling output length without compromising response completeness remains challenging. Aggressive early stopping can reduce generation costs but...
Mahmoud Alyosify, Mirna Imbabi, Eman Elkhamisi et al.
· 0 citations