First-Order LoRA Training with Phone NPUs
On-device fine-tuning lets a large language model (LLM) learn from its user's private data without uploading it. Low-rank adaptation (LoRA) reduces the trainable parameters, but each first-order training step still multiplies by the frozen base-model weights during the forward pass, activation recomputation, and input-...
Xu Zheng, Wei Cheng, Zhuo-Min Chen et al.
· 1 citation