Zhen-Yu Zhang

RiftANN: Efficient Graph Traversal for Vector Search with RDMA-Based Memory Disaggregation

Graph indexes for billion-scale vector collections can exceed a single server's DRAM capacity. Passive RDMA-based disaggregated memory provides scalable capacity without memory-node computation, but conventional best-first search performs poorly in this setting. Fine-grained and unnecessary remote reads increase commun...

TokTier: Exact Stateful Tokenization for Agentic LLM Serving

TokTier: Exact Stateful CPU+GPU Tokenization for Agentic LLM Serving

TokTier is a stateful CPU+GPU tokenization service for this two-mode workload, under one contract that re-tokenizes a small window around the append and splices only when a per-request check finds a stable pre-tokenization boundary.