Skip to content

Author

Ryan Zhang

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#large language models Open access Oct 2026

RABIT-KV

Target-bit-aware KV-cache quantization and physically packed serving for large language model inference. The frozen K3/V2/G32/R4/META8g64 configuration increases observed paged KV capacity on the evaluated H100 system, with higher latency and lower throughput. Canonical logical quality is model-dependent and is evaluat...

Ryan Zhang · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.