Author

Wei-Ling Yang

h-index 6 View on Semantic Scholar

We have 5 of 11 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Open access Oct 2026

Optimizing Deep Neural Network Sparse Kernels on Multi-core CPUs

TurboSparse eliminates im2col by executing SpConv directly over a DNN-oriented sparse format to reduce data movement and improve reuse, introduces row-merging micro-kernels guided by an analytical SIMD-utilization model to increase vector-lane occupancy, and fuses consecutive sparse kernels when their combined working...

Wei-Ling Yang, Jian-Bin Fang, De-Zun Dong et al. · ACM Transactions on Architec... · 0 citations

Preprint Oct 2026

PDScope: Breaking the Prefill-Decode Seesaw for Memory-Bound MoE Inference

PDScope achieves 2.5-10.3x higher prefill throughput and 2.1-6.1x higher decode throughput than existing systems, showing that phase-aware co-design unlocks efficient MoE inference under memory constraints and extends naturally to multi-batch settings.

En-Da Yu, De-Zun Dong, Zhao-Ning Zhang et al. · 0 citations

Preprint Oct 2026

HiNa-MoE: High-Performance, Non-Intrusive MoE Inference on CPUs with Matrix Engines

Mixture-of-Experts (MoE) inference is increasingly deployed in local and on-premise environments, where expert parameters often exceed GPU memory capacity. In latency-sensitive, low-concurrency settings, repeatedly staging routed-expert weights from CPU memory to the GPU can be prohibitive, leaving routed-expert feed-f...

Wei-Ling Yang, Jun-Wen Zhang, De-Zun Dong et al. · 0 citations

Book Open access Sep 2026

AsymFlow: Enabling Long-Context LLM Serving via CPU-GPU Prefill-Decode Disaggregation

This work presents AsymFlow, a prefill-decode disaggregated serving system that runs prefill on the GPU and decode on the CPU, and implements on SGLang and evaluated on a CPU-GPU platform.

Jun-Wen Zhang, Wei-Ling Yang, Jian-Bin Fang et al. · International Conference on... · 1 citation

#large language models Book Open access Sep 2026

AsymFlow: Enabling Long-Context LLM Serving via CPU-GPU Prefill-Decode Disaggregation

Driven by cost and privacy constraints, many organizations deploy large language model (LLM) inference on local CPU-GPU servers. For long-context requests, the key-value (KV) cache grows linearly with sequence length and can rapidly exhaust GPU memory, reducing both the maximum supported context and request concurrency...

Jun-Wen Zhang, Wei-Ling Yang, Jian-Bin Fang et al. · Proceedings of the Internati... · 0 citations