Jia-Yue Feng

Right Number, Wrong State? Measuring Cross-Jurisdiction Substitution in LLM Recall of State Policy

When an LLM answers a state-specific policy question wrongly, it may be hallucinating, or it may be returning a real value that holds in another state. We test this with a minimal-set design: the question wording is fixed and only the jurisdiction varies, across the 50 U.S. states and the District of Columbia (51 juris...