Author

Jian-Xing Qin

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Sep 2026

Vosti: Specifying, Implementing, and Verifying Deterministic LLM Inference

LLM inference systems may vary batch composition, prompt chunking, prefill/decode execution, and KV-cache reuse, eviction, or recomputation. These optimizations should not affect system outputs. Production systems, including vLLM's batch-invariant mode and SGLang's deterministic mode, target this goal but lack a formal...

Jian-Xing Qin, Alexander Du, Dan-Feng Zhang et al. · 0 citations