Mihir Dhanakshirur

Entropy Regularization: A Free Correction to Cross-Entropy for Verified Demonstrations

Large language models are often post-trained on expert demonstrations using cross-entropy (CE), even when the downstream objective is not to imitate the demonstrated solution but to produce any output accepted by a verifier. This mismatch is seen in verifiable domains with multiple correct solutions, such as mathematic...