Jul 2026
BaseRT: Advancing Best-in-Class LLM Inference with Apple M5 Neural Accelerators
These results establish a new performance ceiling for on-device LLM inference and show that the M5's tensor cores are the decisive lever for prompt processing on Apple Silicon.
Fabian Waschkowski, Prabod Rathnayaka, Lukas Wesemann
· arXiv.org · 1 citation