#artificial intelligence
May 2026
Structural Rationale Distillation via Reasoning Space Compression
This work proposes Distillation through Reasoning Path Compression (D-RPC), which constrains the teacher to follow a compact, dynamically maintained bank of reusable high-level reasoning paths, and achieves the highest average accuracy among the evaluated distillation methods.
Jialin Yang, Jiankun Wang, Jia-Jun Wu et al.
· arXiv.org · 0 citations