Elastoformer: Enabling Dynamic Adaptivity via Elastic Model Transformation
This paper proposes Elastoformer: A framework that transforms conventional neural networks into Elastic NN capable of real-time elastic inference, and offers a single, modular solution that dynamically switches between multiple modes of operation at runtime, adapting efficiently to the changing computational budgets of...