AIM-ZO: Activation-Informed Subspace Maintenance for Zeroth-Order LLM Fine-Tuning
AIM-ZO is proposed, a ZO fine-tuning method based on Activation-Informed Subspace Maintenance that uses forward activations as local directional information and continuously integrates them into a broad, evolving subspace over training.