LLMs Learn Better In-Context from Rules than from Examples
It is found that models generally learn more reliably from rules than from examples alone, and additional examples on top of rules or simply scaling up the number of examples do not lead to consistent and significant gains.
Xiang Fu, Seungmin Cho, Yukyung Lee et al.
· 0 citations