To investigate internal mechanisms of linear probing, attribution patching, sparse autoencoders and feature ablation in Llama-3.1-8B, Qwen3-8B, and Gemma-2-9B, linear probing performance peaks substantially earlier than attribution in all three models.
Ariun-Erdene Tumurchuluun, Yusser Al Ghussin, Pinzhen Chen et al.· 0 citations
The Last Translation Benchmark is introduced, a collection of human-authored and peer-reviewed examples that break leading machine translation models and a new evaluation approach: each example comes with handcrafted verification rules describing concrete failure cases on that example, therefore allowing reliable and a...
Vilém Zouhar, Niyati Bafna, Mukund Choudhary et al.· 0 citations
A3D-MoE addresses large language models' challenges with 3-D heterogeneous integration to improve memory bandwidth and reduce NoC overhead/energy, and a hardware resource-aware operation fusion scheduler that fuses attention/MoE operations to boost performance.
Wei-Hsing Huang, Janak Sharda, Cheng-Jhih Shih et al.· IEEE Journal on Exploratory...· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.