Sanjay Govindan

Identifying Temporal Features within Transcoders for Time Sensitive Factual Recall

This work identifies three node categories (common temporal, common to the year, and chrono-semantic) which interact to generate a temporal filter during factual recall and provides the first feature-level map of temporal recall by isolating individual MLP features via transcoder circuit tracing.