K. Srijomkwan

Confident Fools or Careful Searchers? A Behavioural Study of When LLMs Search Beyond Their Static Internal Memory

A benchmark of 400 multiple-choice questions that combines widely known inside-knowledge inside-knowledge questions, which should be answered directly, with outside-knowledge questions about facts from news published after the models'training cut-offs is introduced, which should trigger search or, without tools, absten...