Does Random Search Discover Task Experts? Revisiting Neural Thickets
Pretrained models are typically viewed as generalists, requiring bespoke post-training to achieve task-specific expertise. Gan&Isola (2026) recently proposed a striking alternative: that pretrained models lie in a dense neural thicket of task specialists, which can be surfaced with simple Gaussian weight perturbations....