Efficient training-free query routing framework for federated retrieval-augmented generation
Retrieval-augmented generation (RAG) enhances large language models (LLMs) by grounding responses in external documents retrieved at inference time. In federated RAG (FedRAG), documents are distributed across multiple autonomous corpora that cannot be centrally aggregated due to privacy, regulatory, or organizational c...