When Is Smaller Greener? Right-Sizing Language Models for Agentic AI
A decision model for choosing LLMs in agentic workflows is developed, showing that each resource has a crossover task length at which a smaller, less reliable model ceases to be the greener, cheaper or faster option.
S. Siraj, Maria Barbati
· 0 citations