Vosti: Specifying, Implementing, and Verifying Deterministic LLM Inference
Vosti, an inference engine designed and verified against this specification, produces bitwise-identical logits across every tested execution variation and achieves performance comparable to vLLM's batch-invariant mode on decode-heavy workloads, while providing a stronger, formally verified determinism guarantee.