AdaSplitLoRA: Adaptive Split Federated Learning for Efficient LLM Fine-Tuning in Wireless Networks
This letter proposes Adaptive Split LoRA (AdaSplitLoRA), a framework that jointly optimizes adaptive low rank adaptor (LoRA) rank allocation and dynamic bandwidth allocation for communication-efficient split federated learning (SFL)-based large language model (LLM) fine-tuning. We formulate a joint per-round latency mi...