Whether a language model was trained on a document matters for copyright, privacy, and benchmark contamination. Yet most membership-inference (MI) evaluations on language models collect members and non-members after the fact, so success may reflect distribution shift and failure is inconclusive. We re-ran OLMo 2 1B's o...
A. Banaei, Muhammad Shahzad, Gerald Q. Maguire et al.· 0 citations
GraphTok is presented, a GPU tokenizer that runs the entire encoding pipeline, from pre-tokenization through byte-pair encoding (BPE) merging to token-ID assembly, as one replayable CUDA graph.
Mohammad Siavashi, Pascal Schwinte, A. Banaei et al.· 1 citation
This paper profiles vLLM with FlashAttention-3 and cuBLASLt on an H100 NVL across cold prefill, warm prefill, and decode, sweeping sequence length and batch size, and replaces the usual single utilization number with eight counter-validated views derived from raw Nsight Compute reports.
Mohammad Siavashi, Gerald Q. Maguire, Dejan Kostic et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.