Scaling LLMs via Collaboration: Efficient LLM Inference Across Resource-Constrained Devices
CoSEI is presented, a system that introduces operator-aware partitioning and synchronization-minimizing execution, guided by a lightweight planner and a tailored runtime, that demonstrates that with the right design, collaborative edge inference can make LLMs practical beyond the cloud.
Fei Zeng, Feng Lyu, Hao Wu et al.
· IEEE Transactions on Mobile... · 0 citations