Skip to content

Author

Jiaye Teng

We have 3 of 13 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Oct 2026

A Fine-Grained Analysis of the LoRA Fine-Tuning Landscape with Implications for Data Selection

It is proved that sufficient rank over-parameterization, with the required rank explicitly determined by the LoRA-RIP constant, eliminates spurious local minima, thereby extending existing RIP-based guarantees beyond the classical 1/3 regime and enables principled data selection under a fixed rank budget.

Bo-Wen Zhang, Chang-Rui Fang, Xin Ma et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Normalize-Then-Precondition: A Hierarchical Approach to Marginal Scale and Interaction Geometry for LLM Training

NormPre is developed with NormPre-G and NormPre-L adopting global and localized spectral preconditioning, grounded in spectral-norm steepest descent and a regularized formulation followed by leading mode selection, respectively, to enable large-scale training.

Zi-Xuan Gong, Ze-Yu Gan, Jia-Ye Teng et al. · 0 citations
Jul 2026

Hyperball May Not Be a Free Lunch

An angular effective learning rate is derived that accounts for the parameter-update angle, parameter norm, and update norm, and shows that the conventional norm-based measure is a special case under parameter-update orthogonality.

Yihao Xiao, Jialong Sun, Zitian Gao et al. · 3 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.