To mitigate the refusal-cue shortcut, sparse complementary masking is adapted as a lightweight post-hoc intervention that identifies and suppresses a small set of shortcut-associated attention heads and MLP neurons without retraining and achieves an approximately 79% relative reduction in response-initial detection fai...
Yu Feng, Chun-Ting Zang, Chen Shen et al.· 1 citation
This work presents Meta's network architecture and software stack designed to support one of the world's largest RoCE fabrics, currently connecting over 100,000 GPUs across multiple datacenter buildings, and introduces a scalable initialization strategy that reduces startup times by 11× via eager process group creation...
Hongyi Zeng, Min Si, Pavan Balaji et al.· Conference on Applications,...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.