UvA-DARE (
This work studies the repetition problem for encoder-decoder models, using both recurrent neural network (RNN) and trans-former architectures and proposes token loss dynamic reweighting (TLDR) that applies differentiable weights to individual token losses.