Neural networks are likely to be among the most consequential artefacts in human history. As these systems become more capable and autonomous, their potential to cause societal harm also grows, making AI safety one of the defining challenges of our time. Yet we continue to build increasingly powerful systems without fu...
Fazl Barez, Tung-Yu Wu, Hunar Batra et al.· 0 citations
Localizing latent structures in the activation space of language models (LMs) is central to understanding and controlling their behavior. Yet, localized structures can differ substantially in their causal influence, raising the question of what makes a structure actionable. We tackle this question by casting causal inf...
This work leverage Mixture of Factor Analyzers (MFA) as a scalable, unsupervised alternative that models the activation space as a collection of Gaussian regions with their local covariance structure, and positions local geometry, expressed through subspaces, as a promising unit of analysis for scalable concept discove...
Or Shafran, S. Ronen, Omri Fahn et al.· arXiv.org· 10 citations· ⚡2
This work establishes that precise embedding-level intervention is necessary for robust concept erasure, and demonstrates that existing methods can benefit from such augmentation, with minimal coherence loss.
C. Suslik, Or Shafran, Mor Geva· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.