Recirculation
This work describes an inference-time architectural enhancement for off-the-shelf foundation models that markedly reduces perplexity and boosts accuracy across generation and reasoning tasks, and proposes and evaluates an adaptive variant of recirculation which requires only light tuning of hyperparameters while freezing the original model weights.
Michael C. Mozer, Shoaib Ahmed Siddiqui, Danny Sawyer et al.
· 0 citations