Md Toki Tahmid

Sparse Autoencoders Reveal Structural and Family-level Features in BiRNA-BERT

Motivation RNA language models learn representations that support structure and function prediction, but which biological concepts their hidden states encode remains unclear. Sparse autoencoders (SAEs) decompose hidden states into interpretable features, yet have not been applied to RNA language models, where byte-pair...