H. Esmaeili

Empowering edge intelligence through reparameterized lightweight transformers and distributed inference

A reparameterized transformer framework that integrates High-Rank Factorization (HRF) during training, layer merging at inference, and dynamic, load-balanced distributed inference across multiple devices is proposed, highlighting that reparameterized transformers, coupled with adaptive distributed inference and ultra-l...