Do Factuality Methods Make LLMs More Factual? Reproducibility and Fair Comparison
Large Language Models (LLMs) are aligned to human preferences, after pre-training and supervised fine-tuning steps. However, standard RL alignment steps such as RLHF do not focus on factuality of LLMs, hence they may generate non-factual information, which could result in unintended consequences. In response, a number...
Pratuat Amatya, Vinay Setty, V. Venktesh et al.
· 0 citations