Skip to content

Author

Xiaowei Li

We have 3 of 39 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Open access Nov 2026

Chat-Fusion: An Efficient Batch Inference System for Cloud LLMs Serving

Batch processing is useful for optimizing the utilization of various hardware resources, such as GPUs, CPUs, and other specialized accelerators, and is also important for improving the throughput of LLM serving. Many research works have been conducted for better batching and scheduling policies for the efficiency of cl...

Jin-Xin Yu, Lei Wang, Meng-Di Wang et al. · 0 citations
Conference Sep 2026

Taichi: Elastic Multi-LLM Serving with Coordinated Memory–Compute Multiplexing

The rapid adoption of LLM applications is driving up serving cost, yet GPUs remain underutilized in practice due to single-model provisioning and highly variable, long-tailed workloads. Co-locating two or more LLMs on one GPU can improve utilization, but it requires fast and coordinated control of both KV cache/paramet...

Cun-Chi Lv, Xiao Shi, Zheng-Yu Lei et al. · 0 citations
Sep 2026

HydraPIM: A Heterogeneous PIM Architecture for Efficient Attention in Long-Context LLMs

The growing demand for long-context LLM inference has exposed a critical bandwidth–capacity trade-off in memory systems, rendering single-tier PIM architectures ineffective. HBM-PIMs offer high bandwidth but limited capacity, while DIMM-PIMs provide scalability at the cost of lower bandwidth; neither satisfies the thro...

Shixin Zhao, Lian Liu, Xiangwen An et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.