Author

Dongqian Li

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Distilling and Scaling Hierarchical Vision Transformer to 30B Parameters

This work proposes EHV, an Efficient Hierarchical ViT architecture designed for massive scaling, and introduces a Sparse Mixture-of-Experts (SMoE) variant, pushing the scale to an industry-leading 30B parameters.

Shuguang Dou, Dongqian Li, Haoyang Jiang et al. · 0 citations