IronLLM: Forging Compact Edge-Native Language Models for Real-Time Embodied Intelligence
We present IronLLM-0.6B, a 654M-parameter language model designed for efficient on-device inference. IronLLM-0.6B combines a hybrid attention architecture with X-MTP, a lightweight shared-KV multi-token prediction design that eliminates per-depth KV-cache replay and employs a lightweight verification head for rollback-...
Chang-Di Yang, Feng-Quan Jiao, Hao-Chih Lin et al.
· 0 citations