This work analyzes compositional target functions of three-layer fitting using an explicit three-layer fitting model trained via layer-wise spectral estimators, and establishes Gaussian comparison bounds for projected moments when $0<\varepsilon<1/3$, and motivates separations in sample complexity between two- and thre...
Hugo Tabanelli, Yatin Dandi, Luca Pesce et al.· arXiv.org· 2 citations
Neural Low-Degree Filtering (Neural LoFi) is introduced, a stylized limit of gradient-based training in which hierarchical feature learning becomes an explicit iterative spectral procedure and provides a mathematically explicit framework for studying multi-layer feature learning beyond the lazy regime.
This work studies attention-indexed models, a broad framework that can represent multi-layer and multi-head attention architectures, and reveals that attention parameterization itself can act as an architectural implicit bias.
Yi-Zhou Xu, M. Sagitova, L. Zdeborová et al.· 0 citations
It is proved that the AMP-derived preprocessing of [Defilippis et al., 2025] is optimal among all bounded matrix-valued preprocessing maps of any fixed dimension and the general spectral conjecture of [Defilippis et al., 2025] is proved.
Florent Krzakala, Pierre Mergny, Vanessa Piccolo· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.