Aryo Lotfi

Soft Guidance Starts to Outperform CoT Prompting as LLMs Improve

It is suggested that using standard CoT prompting increasingly acts as a source of distraction as models grow stronger, because standard CoT prompting also demands style adaptation, formatting compliance, and potentially undesired contextualization, which can distract models from the core reasoning task.