Skip to content

OpGuard: Bitwise Alignment for Precise and General Debugging of Production LLM Training

Unknown authors
· 2 citations · 88 references
View source

Similar papers

Preprint Aug 2026

JITterFlip: Uncovering Fault Attack Surfaces in JIT-Compiled LLM Serving

JITterFlip is presented, the first BFA targeting the host-side JIT serving control plane of GPU-based LLM inference, and develops a decision-guided fault-vulnerable code analysis that enables both gibberish output generation and a correct-output sponge attack.

Tai-Rui Wang, Zhi Zhang, Yan-Song Gao et al. · 0 citations
Preprint Aug 2026

Aray: Deterministic-First Synthesis of Benign Artifacts for YARA Validation

This work presents Aray, a deterministic-first YARA interpreter and positive-fixture synthesizer, a deterministic-first YARA interpreter and positive-fixture synthesizer that validates generated fixtures against their source rules.

Emanuel C. A. Valente, Lourenço A. P. Júnior, L. Chahud et al. · 0 citations
#machine learning Preprint Aug 2026

Deterministic LLM Inference Across GPU Kernels: Power-of-Two INT8 Quantization Scales and the Limits of Tolerance-Based Conformance

It is found that every one of five epilogue faults -- scale precision, double rounding, multiplication order, output truncation, fused ordering -- moves the output by at most a single bfloat16 spacing, and by exactly one whenever it moves it at all, across 5,880 cells.

Teng-Ruei Chen · 1 citation
#machine learning Preprint Aug 2026

TrainSDC: Characterizing and Mitigating Silent Data Corruption in Large Language Model Training

This work presents the first systematic characterization of SDC vulnerability across major computation interfaces in both the forward and backward passes of Transformer training, and proposes TrainSDC, a characterization-guided protection framework consisting of Q/K-path recomputation, residual-gain monitoring, and exp...

Zhijie Xia, Haotian Xu, Si-Yu Yun et al. · 0 citations
Jul 2026

Leaky Language Models: Stealing Architecture and Inference Optimizations via Per-Token Timing

This work presents LeakyLMs, a set of attacks that leak proprietary model, architecture, and deployment information from production language models. LeakyLMs is the first to demonstrate that key model and deployment details can be inferred using only token generation timing, even when interacting through remote APIs. L...

Sadegh Majidi, Niloofar Mireshghallah, Kazem Taram · 0 citations
Preprint Aug 2026

Oilbird: Training-Free Speculative Decoding with Keys the Verifier Already Computes

A second, semantic draft source is proposed: the same pool, re-keyed by the hidden state the verifier has already computed at each committed token, together with a merge that lets it ride inside an existing lexical drafter's tree.

Tao Jin, P. Nguyen, Zhenzhu Yan et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.