Open access
Jul 2025
A3D-MoE: Acceleration of Large Language Models With Mixture of Experts via 3-D Heterogeneous Integration
A3D-MoE addresses large language models' challenges with 3-D heterogeneous integration to improve memory bandwidth and reduce NoC overhead/energy, and a hardware resource-aware operation fusion scheduler that fuses attention/MoE operations to boost performance.
Wei-Hsing Huang, Janak Sharda, Cheng-Jhih Shih et al.
· IEEE Journal on Exploratory... · 3 citations