Skip to content

Author

Xu Han

We have 2 of 9 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Sep 2025

Concertina: Data-Centric Adaptive Pipeline Parallelism for Efficient Heterogeneous Long-Context LLM Training

This paper proposes DPP, which transforms PP granularity from a static design choice into a workload-adaptive optimization space over packed, split, and hybrid chunks and further introduces a new coupling between heterogeneous pipeline scheduling and gradient checkpointing.

Shiju Wang, Yujie Wang, Fang-Cheng Fu et al. · 0 citations
Preprint Aug 2026

StateFlow: Sequence Pipeline Parallelism for Long-Context Modeling with Linear Recurrence

StateFlow is presented, a sequence pipeline parallelism system for models with linear recurrence that partitions each sequence into chunks and schedules their execution while propagating boundary states and gradients across chunks, thereby reducing activation lifetimes and improving training throughput.

Wenxuan Zhao, Yingfa Chen, Xu Han et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.