In diffusion-based generation, a neural network can be trained to predict the clean data, the noise, or the velocity from a noisy input, yet plain Diffusion Transformers operating on large pixel patches succeed with clean prediction and fail with noise or velocity prediction.
Tong-Tong Liang, Si-Qi Kou, Zi-Qiao Xi et al.· 0 citations
This work characterize task-space complexity through covering numbers under a prescribed metric, thereby quantifying the low-dimensional cross-task structure without requiring an explicit parametric representation and explicitly construct a Transformer that exploits their low-dimensional structure to perform ICL.
Zhong-Jie Shi, Rong-Jie Lai, Alexander Cloninger et al.· 1 citation
It is proved that an alternating Riemannian gradient scheme converges to a basin saddle point of the penalized DRO problem, recovering the linear and polynomial rates of the abstract theory with all constants explicit in terms of data dimension, loss moments, and the reference covariance.
Rishabh Dixit, Pranav Upadrashta, Alexander Cloninger· 0 citations
This work proposes a simple and effective column-selective graph sampling algorithm based on a minimum inner product greedy selection rule, well-suited for large-scale graphs where the full Laplacian cannot be stored in memory.
Zhaiming Shen, Alexander Cloninger· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.