Is Human-Readable Text Necessary for Effective LLM Fine-Tuning?
Is human readability necessary for effective fine-tuning of large language models? We investigate whether model-conditioned training representations can preserve or improve adaptation utility without requiring a human-readable textual form. We propose Desired-Update-Aligned Synthetic Data (DASA), which uses activation-...
Jin-Hao Zhang, Ze-Yu Liu, Zi-Cheng Yan et al.
· 0 citations