Predictable Scale (Part II) - Farseer: A Refined Scaling Law in LLMs
This work introduces Farseer, a novel and refined scaling law offering enhanced predictive accuracy across scales, and provides new insights into optimal compute allocation, better reflecting the nuanced demands of modern LLM training.