Conditional co-ablation (CoAx) is introduced, which ranks candidates by growth in ablation effect after primary-set removal, and coAx completions outperform matched random completions on all 8 non-GPT-2 models spanning 6 architecture families.
Z. Gong, He Lu, Tian-Tong Wang et al.· arXiv.org· 7 citations
State of Thought is proposed, a new reasoning paradigm that enables endogenous reasoning in LLMs, with the model's internal reasoning state governing how reasoning unfolds, and provides a generalizable and efficient alternative to existing test-time reasoning paradigms.
Z. Gong, Yi-Kun Hou, Zi-Hao Zeng et al.· 0 citations
CoCurve (Cross-Module Co-Pruning Curvature), a calibration-only, fine-tuning-free method that prunes attention and FFN units jointly, and reduces to one budgeted quadratic program, solved in a single shot under a shared attention--FFN budget, with no labels, fine-tuning, or recovery.
Z. Gong, Zihao Zeng, Zijie Wang et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.