Jul 2026
ThAME: 3D Memory-Enabled Heterogeneous Accelerator for LLM Mixture of Experts
ThAME is proposed, a three-dimensional (3D) heterogeneous multi-chiplet architecture for MoE inference that employs Ferroelectric Field-Effect Transistor-based non-volatile and DRAM-based volatile memory chiplets with a co-designed compute mapping strategy that aligns the distinct computational profiles of attention me...
Pratyush Dhingra, Pramit Kumar Pal, J. Doppa et al.
· arXiv.org · 0 citations