LoopICL: Looping a single transformer block to solve tabular tasks
LoopICL, a looped transformer whose core design decouples parameter count from computational depth, is introduced, a looped transformer whose recurrent design enables users to also trade off inference cost and performance, providing a resource-aware TFM.
Amir Rezaei Balef, Katharina Eggensperger
· 0 citations