Mixture-of-Experts Language Models Can Be Strong and Efficient Retrievers
The number of experts used for query encoding can be reduced without retraining or re-indexing, retaining more than 99% of retrieval effectiveness while reducing query encoding time by up to 26%.
Anubhav Shrestha, Safal Shrestha, Minwu Kim et al.
· 0 citations