Skip to content

Author

Da-Wei Yang

5 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

Fine-Grained Units, Flat Decisions: Hierarchical Micro-Expert Pruning for Mixture-of-Experts Models

Micro-expert pruning reduces the capacity of mixture-of-experts (MoE) models by removing coupled channels within routed experts. However, finer pruning granularity alone does not guarantee the preservation of downstream capabilities, as similar language-modeling perplexity can accompany substantially different task per...

Zu-Kang Xu, Xin-Pei Gao, Xing Hu et al. · 0 citations
#artificial intelligence Preprint Oct 2026

LoopQuant: Accurate and Efficient Post-Training Quantization for Looped Transformers

Looped Language Models (LoopLMs) improve parameter efficiency by recursively reusing shared Transformer modules, yet their repeated computation over evolving recurrent states poses new challenges for low-bit deployment. Existing post-training quantization (PTQ) methods, largely designed for feed-forward Transformers, f...

Zhi-Xiong Zhao, Zu-Kang Xu, Xing Hu et al. · 1 citation
Open access Sep 2026

Efficient Log Anomaly Detection via Dual-Domain State Space Modeling

Log anomaly detection requires models that capture long-range event dependencies without the quadratic sequence-length cost of self-attention. We present LogMamba, a reconstruction-based model that combines a bidirectional selective state-space branch with a Multi-Scale Frequency Learner (MSFL). The sequence branch mod...

Xian-Lang Hu, Guang-Sheng Feng, Rui-Ni Wang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

All for 1-Bit: Towards Genuine 1-Bit Post-Training Quantization for LLMs

All for 1-Bit (AF1) is proposed, a genuine 1-bit PTQ framework for LLMs that consistently outperforms existing binarization-based PTQ methods in perplexity and zero-shot accuracy, providing a practical path toward deployable genuine 1-bit compression for LLMs.

Zhi-Xiong Zhao, Zu-Kang Xu, Guang-Yu Sun et al. · 4 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.