Skip to content

Understanding language model scaling for protein fitness prediction

Jul 2026 · Nature Computational Science · Vol 6, pp. 778 - 788 · 2 citations · 45 references
Medicine

TL;DR

It is shown that model size, training dataset and stochastic elements can bias the predicted p(sequence) away from real fitness, which clarifies the scaling behavior of protein models on fitness prediction and provides practical guidelines for their application and future development.

View source

Similar papers

Open access Jul 2026

Protein language models learn underlying mutation biases alongside fitness landscapes

A parameter sweep is implemented to explicitly couple empirical nucleotide mutational supply from PLM-assessed amino acid substitution pseudo-probabilities across evolutionary forecasting tasks and finds that base PLMs implicitly learn generic nucleotide-level mutational constraints, an effect strongly amplified by vir...

O. MacLean, Kieran D. Lamb, Spyros Lytras et al. · 0 citations
Open access Jul 2026

Expanding the scope of protein language modeling to protein-protein interactions with MSA Pairformer.

Multiple sequence alignment (MSA) Pairformer is presented, a protein language model that builds on AlphaFold2/3's bidirectional refinement between sequence and pairwise residue representations to accurately model the evolution of protein-protein interactions, despite training exclusively on individual chains.

Yo Akiyama, Zhidian Zhang, Olivia Tang et al. · 3 citations
Open access Aug 2026

Protein language models and the long tail of functional diversity

It is found that many GigaRef singletons belong to a cluster under alternative parameter settings, suggesting that genomic and metagenomic datasets may require dataset-specific clustering configurations, and it is shown that singletons share mutual information with clustered sequences, making them learnable by PLMs and...

R. Vinod, Samir Char, Ava A. Amini et al. · 0 citations
Open access Aug 2026

MAXWELL: Calibrating the probabilistic outputs of protein language models to the mutation-induced stability change landscape

MAXWELL (Matrix-wise Landscape Learning), a novel post-training method that calibrates the probabilistic outputs learned by protein language models during pretraining to generate mutational landscapes that quantify the effects of individual amino acid substitutions on protein stability, is introduced.

Ming-Chen Li, Xiaoran Cheng, Fan Jiang et al. · 0 citations
Open access Aug 2026

Unobserved Sequence Space Has Many Functional Proteins

It is determined that portions of protein sequence space, despite being unobserved in nature, contains many functional proteins that cannot be predicted accurately in silico, providing experimental support for the hypothesis that natural protein sequences explored by evolution represent a miniscule fraction of all poss...

Nathan Diplock, Thomas A. Desautels, Riyaz Haque et al. · 0 citations
Open access Jul 2026

Evaluating the cross-species transferability and scaling of sequence-to-function predictions in AlphaGenome

This work developed a scoring-approach for AI-agents to autonomously assess AlphaGenome prediction confidence and accurately differentiate between AlphaGenome’s robust sequence-level recognition across species and its current limitations when interpreting un-fine-mapped regulatory variants.

Priya Ramarao-Milne, Suyu Ma, L. Sng et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.