Robert Feldt

Foreword: Pre-Generation Prediction and Characterisation of LLM Test Failures using the Jacobian Lens

This work presents Foreword, a framework built on two ideas: learn from both passing and failing references, and represent inputs through the Jacobian lens, an interpretability technique that reads intermediate activations out as scores over vocabulary tokens, which can support testers for prioritising inputs, checking...