Fine-Tune, Then Rectify
A two-stage framework that combines fine-tuning and rectification, and optimally allocates limited labeled samples across the two stages is developed, and validates the fine-tuning scaling law and confirms that the proposed optimal allocation rule reliably identifies the optimal sample allocation.
Lei Wang, Zikun Ye, Jing-Long Zhao
· 5 citations