Author

Xingyu Zhao

h-index 0 View on Semantic Scholar

We have 2 of 2 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Aug 2026

SubZero+: Memory-Efficient Adaptive Zeroth-Order LLM Fine-Tuning in Random Subspaces

Zeroth-order (ZO) optimization with SGD in random subspaces enables memory-efficient fine-tuning of large language models without backpropagation. However, high gradient estimation noise fundamentally undermines adaptive optimizers like Adam. We propose SubZero+, which achieves practical adaptive ZO optimization throug...

Zi-Ming Yu, Shu-Yao Xiao, Xingyu Zhao et al. · 0 citations

#machine learning Preprint Aug 2026

SubZero+: Efficient Zeroth-Order LLM Fine-Tuning via Large Learning Rates

Experiments show that SubZero+, an improved SubZero framework that improves stability in three complementary ways, consistently outperforms prior ZO baselines, enlarges the stable learning-rate range, and narrows the gap to first-order methods with minimal extra memory overhead.

Ziming Yu, Shu-Yao Xiao, Xingyu Zhao et al. · 0 citations