DKL: Decoupled Knowledge Learning for Instruction-Tuned Language Models
RAG has become the de facto method for incorporating new, corpus-specific knowledge into an instruction following LLM (Instruct LLM). Although RAG-based prompting improves factual grounding, it fails when retrieval is incorrect or incomplete, leading to hallucinations. Finetuning methods such as RAFT and PA-RAG enhance...
Kushagra Bhushan, Meghanadh Pulivarthi, Sai Krishna Reddy Sathi et al.
· 1 citation