Ask the Tool, Don't Guess: Agent Tool Calls Hold Their Progress, and the Serving System Should Read It
This work proposes that tool calls report their progress explicitly while they run, and measures what that takes, and shows that at the points where a KV cache decision is made, the reported progress is between several times and an order of magnitude more accurate than the best published predictors, and it stays accura...
Yi-Peng Liu, Yingqiang Zhang, Fei-Fei Li et al.
· 0 citations