FlashBack: Efficient Retrieval-Augmented Language Modeling for Fast Inference
FlashBack is proposed, a modular RALM designed to improve the inference efficiency of RALM with appending context pattern while maintaining decent performance after fine-tuning by Low-Rank Adaption and introduces Marking Token as two special prompt tokens for marking the boundary of the appending context during fine-tu...
Runheng Liu, Xing-Chen Xiao, Heyan Huang et al.
· Annual Meeting of the Associ... · 2 citations