Cliff Tokens: Analyzing Failure Trigger Tokens in LLM Mathematical Reasoning
This work introduces the cliff token, a token at which the estimated probability of reaching the correct answer (success probability) drops beyond an adaptive threshold, and introduces a cliff taxonomy of deterministic, uncertain, and sampled-off cliffs, defined by greedy choice and token entropy.