Skip to content
Review

Withholding the Completing Chunk: Deterministic Pair-Completion Guardrails for Streaming LLM Output

· 0 citations · 17 references

TL;DR

A narrower deterministic construction in which each output-danger signature is the conjunction of two lexical predicates, and before releasing each chunk, the guard scans the accumulated prefix and withholds the first chunk that makes both predicates observable.

View source

Similar papers

Preprint Aug 2026

Oilbird: Training-Free Speculative Decoding with Keys the Verifier Already Computes

A second, semantic draft source is proposed: the same pool, re-keyed by the hidden state the verifier has already computed at each committed token, together with a merge that lets it ride inside an existing lexical drafter's tree.

Tao Jin, P. Nguyen, Zhenzhu Yan et al. · 0 citations
Preprint Aug 2026

Certified Split Points for Parallel Lexing: Exact and Modulo Discarded Tokens

The guarantee to equality after deleting a declared discarded set is weakened, and a second condition, sound and more permissive, is given, which turns delimiter-based parallel lexing from a language-specific assumption into a property a compiler checks.

Nicklas Nidhögg · 3 citations
#artificial intelligence Preprint Sep 2026

JustFit: 200K-Token LLM Serving on a 24 GiB Laptop with Just-in-Time State Management

Capable open-weight models make local coding and reasoning attractive, but their context and execution state strain laptop memory. We present JustFit, an MLX-based inference runtime that combines KVExec for compressed KV execution, PhaseSwap for component residency, and StateTrans for state-preserving serving transitio...

Yu-Hua Chen · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.