Jung-Ho Hong

Negative Contrastive Chain-of-Thought Distillation for Transfer Reasoning Capability to Small Language Models

Large language models (LLMs) demonstrate strong reasoning capabilities through chain-of-thought prompting. Recently, numerous studies have focused on transferring reasoning capability from LLMs to small language models (SLMs) through chain-of-thought (CoT) distillation. However, these approaches face two limitations. F...