Author

Tian-Qi Chen

h-index 3 View on Semantic Scholar

We have 2 of 10 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Oct 2026

Let the Gate Decide: Per-Lookup Precision for Quantized Conditional Memory in LLMs

Conditional memory layers, such as DeepSeek's Engram, attach large hashed n-gram tables to a language model, and removing them from DeepSeek-V4.1-Flash costs 36.8 PopQA points. Low-bit quantization loses long-tail facts first, and the standard remedy, giving more bits to frequently accessed rows, backfires: refining lo...

Tian-Qi Chen, Xun-Chao Li, Li Xie et al. · 0 citations

#artificial intelligence Preprint Sep 2026

You Only Need 2/3 of the Chosen Experts: An Empirical Study of Dynamic Expert Pruning in Fine-Grained MoE LLMs

It is found that expert selection is far more redundant than the field's operating points assume, and how much expert computation fine-grained MoEs can dispense with is revealed, and when dynamic allocation earns its complexity is established, informing both practical deployment and future pruning methods.

Yuan-Teng Chen, Qi-Wei Lai, Tian-Qi Chen et al. · 1 citation