N. Meratnia

AutoEncoder-Compressed Parallel Split Learning for Pre-trained Model Fine-Tuning

AE-PSL is proposed, a communication-efficient PSL framework that compresses intermediate activations and gradients using a lightweight AutoEncoder placed at the split layer and introduces a novel two-stage alignment mechanism, which adapts the AE to the pre-trained model's feature manifold and client-specific feature distributions before DFT.