Do contract terms that protect investment between people also protect it between profit-maximizing language-model agents? In the hold-up problem, a seller can adapt a unit to one buyer at a cost before the price is set. Once that cost is sunk, the buyer can offer almost nothing and the seller will still accept, so a se...
Jun-Wei Yao, Zi-Ke Yang, Yong-Xin Zhou et al.· 0 citations
Whole-prompt translation evaluates a request in different languages but does not compare which component carries a language. We introduce a paired reversal: translate the complete request component or the complete operation component into the same target language, holding behaviour, English frame and translated-span co...
Yong-Xin Zhou, Jun-Wei Yao, Wen-Bo Ye et al.· 0 citations
Deployed classifiers often act on a prediction only when its confidence clears a threshold and pass the rest to a person. We ask whether one threshold serves all languages equally on typed decision interfaces, APIs that return a probability for each option of a fixed multiple-choice question. In a confirmatory study wi...
Jun-Wei Yao, Yong-Xin Zhou, Zi-Ke Yang et al.· 0 citations
This work evaluates compaction on later questions of language-model agents, using four corpora that annotate the evidence of several questions per text and recorded agent trajectories, and compares every method with random deletion at the same budget.
Jun-Wei Yao, Yong-Xin Zhou, Zi-Ke Yang et al.· 0 citations
Automatic safety judges -- for example Llama Guard, or GPT-4o given a grading prompt -- produce the numbers behind reported jailbreak success rates, defense evaluations, and safety leaderboards. We ask whether these judges grade what a reply contains or how it sounds. We place a fixed piece of text before or after a mo...
Yong-Xin Zhou, Wen-Bo Ye, Yuan-Zhe Liu et al.· 0 citations
A benchmark score is a measurement instrument, yet most benchmarks read each item at a single canonical surface form. We ask whether that reading is faithful: when an item's intent is held fixed and only its meaning-preserving surface form varies, does the canonical-form score estimate model behavior well, and how much...
Yongxin Zhou, Jun-Wei Yao, Yuanzhe Liu et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.