SFAD: Speculative Factuality-Aware Decoding
SFAD is presented, a speculative decoding framework that enhances contextual faithfulness without inference degradation and substantially improves faithfulness while achieving $2.48\times$ speedup, offering a practical solution for efficient LLMs.
Guan-Qiao Chen, Di Wang, Lijie Hu
· 0 citations