Energy constraints in large scale artificial intelligence and insights from human cognition for efficient large language models
Abstract Large-scale artificial intelligence (AI) systems, especially large language models (LLMs), face growing constraints related to energy use, power delivery, memory traffic, experimentation, and infrastructure capacity. These pressures are often studied separately, which makes it difficult to understand how they...