Learn Your Own Thoughts: Abstract Token Curriculum
Large Language Models (LLMs) have achieved remarkable reasoning capabilities by utilizing chain-of-thought (CoT) as a scratchpad for intermediate stages of thinking. However, CoT techniques require explicit supervision on thinking tokens, which requires rich, task-specific data. In this work, we propose Abstract Token...
Khashayar Gatmiry, Avrajit Ghosh, Parsa Mirtaheri et al.
· 0 citations