LLM fingerprinting via watermark distillation embeds a statistical watermark signal into model weights, enabling model owners to identify their models behind black-box APIs. Revisiting a recent protocol, we find that its utility evaluation understates text quality degradation in open-ended generation, favoring overly s...
Jeongyeon Hwang, Anshul Nasery, Sewoong Oh et al.· 0 citations
Mixture-of-Experts (MoE) architectures scale language models efficiently by activating only a few experts per token, but the saving is confined to computation: every expert must stay resident on the accelerator, so memory bounds where these models can be deployed. Expert pruning reduces this footprint, yet existing met...
Jabin Koo, Soheil Abbasloo, Sungjae Lee et al.· 0 citations
Auditing publicly released descendants of distilled models spanning diverse post-training objectives, SCOUT consistently identifies the distillation source and tracing teacher-associated *syntactic signatures* along training trajectories reveals that they emerge during distillation and persist through subsequent prefer...
Minwoo Jang, Jaechang Kim, Minhyeon Oh et al.· 0 citations
Confidence-Gated Transductive Test Generation (CoTT), which first uses an efficient inductive procedure and invokes transductive generation only when inductive confidence is low, improves output reliability while allocating extra computation only when needed.
Sungjae Lee, Youngsik Yoon, Seockbean Song et al.· 0 citations
Text Prompt Boosting (TPB), an AdaBoost-inspired framework that treats each text-prompt-based classifier as a weak learner and sequentially aggregates them into a strong ensemble by explicitly targeting hard, misclassified examples, is proposed.
Seokhee Jin, C. Sung, Sunung Mun et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.