This work proposes AdaptCore, an adaptive framework for universally high-performance MatMul on Ascend NPUs, which systematically decouples operator optimization into spatial tiling and instruction orchestration and integrates a composable optimization library with a deterministic analytical performance model.
Yuhang Zhou, Jianglan Peng, Qian-Yu Jiang et al.· 0 citations
Bole is presented, a kernel--runtime co-design that enables efficient tree speculation for hybrid-attention LLMs and couples efficient state management with a batch-wide verification budget calibrated to the complete hybrid forward.
This paper systematically analyzes failures encountered during large-scale RL training on the Huawei Ascend platform, summarizes representative failure types, and identifies three model-side factors relevant to fault reproduction.
Yikai Wang, Chuansai Zhou, Yuhang Zhou et al.· 0 citations
Results show that template-anchored decomposition and stage-specific GPU execution can scale matrix completion beyond device-memory capacity, and show that template-anchored decomposition and stage-specific GPU execution can scale matrix completion beyond device-memory capacity.
Chengying Huan, Yu-Bo Wang, Pin-Huan Wang et al.· 0 citations
SpecLA is presented, a speculative decoding runtime for stateful linear-attention models that verifies chains and trees with topology-aware kernels, stores compact factors produced during verification to recover accepted states, and uses confidence pruning plus a target-aligned EAGLE-style drafter to feed useful candid...
Zhibin Wang, Xuying Han, Zhaohua Yang et al.· arXiv.org· 1 citation
RVANNS is presented, an RVV-oriented ANNS engine that jointly optimizes vector representation and graph locality and achieves 3.39x and 4.94x speedups over scalar execution on real 128-bit and 256-bit RVV processors, respectively.
Cheng-Ying Huan, Yudong Liu, Jian-Guo Wang et al.· 0 citations
MISA-T, a routing-layer admission policy for mixed rollout serving that combines adaptive session admission, workload-aware KV-capacity allocation, and residency-time-aware KV accounting, is presented.
Zetao Hong, Song Yuan, Yuan-Hao Ding et al.· 2 citations· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.