Xin-Wu Liu

IFCLoRA: Topology-Aware Rank Allocation for Parameter-Efficient Fine-Tuning

Low-Rank Adaptation (LoRA) is a widely used approach to parameter-efficient fine-tuning (PEFT) of LLMs whose effectiveness depends on rank allocation. Existing adaptive LoRA methods derive ranks from local gradient, activation, or matrix statistics collected before or during fine-tuning; training-time variants add over...