SAPE: Sandwich Adapters for Parameter Efficiency in Large Language Model Fine-Tuning
SAPE (Sandwich Adapters for Parameter Efficiency), a PEFT framework based on a sandwich-style hard weight-sharing topology, formalizes an inherent capacity trade-off: while hard parameter sharing strongly regularizes semantic generalization, it slightly smooths the sharp layer-wise transformations required for rigid mu...