This work identifies the high-sparsity trap, a unified acceleration framework for visual generation that combines a short sparse warm-up, few-step trajectory-mixed distillation, and FP8 quantization with fused kernels, and sustains attention sparsity with strong visual quality on long-sequence 720P generation across Wa...
Yu-Xi Liu, Hao-Yu Li, Ze-Kun Zhang et al.· 0 citations
Diffusion Transformers (DiTs) achieve strong video generation quality, but their dense spatiotemporal self-attention scales quadratically with sequence length and quickly becomes the dominant inference bottleneck. Sparse low-rank hybrids alleviate this cost by combining a local sparse branch with a global compressed br...
Ze-Kun Zhang, Yi-Xiang Cai, Yu-Xi Liu et al.· 1 citation
RhinoVLA is proposed, a deployment-oriented VLA model co-designed with the Huixi R1 edge SoC that adopts a token-efficient Qwen3-VL backbone and a continuous Action Expert, reducing the VLM-side token and computation burden while preserving pretrained multimodal capability.