Ananya Singha

Asking language models how to represent data for fine-tuning

It is shown that format choice remains important even after fine-tuning; models learn more efficiently with specific formats rather than adapting to any format; this finding allows format selection to be done via inference alone, avoiding costly trial-and-error fine-tuning runs.