Structure-Aware Masking for Protein Representation Learning
Bucket Masking is introduced, a structure-aware masking strategy that selects groups of residues based on their proximity in three-dimensional space, preferentially masking structurally coupled regions during training, and enables up to a 14% improvement over standard random masking in downstream protein fitness predic...