It is shown that model size, training dataset and stochastic elements can bias the predicted p(sequence) away from real fitness, which clarifies the scaling behavior of protein models on fitness prediction and provides practical guidelines for their application and future development.
A parameter sweep is implemented to explicitly couple empirical nucleotide mutational supply from PLM-assessed amino acid substitution pseudo-probabilities across evolutionary forecasting tasks and finds that base PLMs implicitly learn generic nucleotide-level mutational constraints, an effect strongly amplified by vir...
O. MacLean, Kieran D. Lamb, Spyros Lytras et al.· bioRxiv· 0 citations
Multiple sequence alignment (MSA) Pairformer is presented, a protein language model that builds on AlphaFold2/3's bidirectional refinement between sequence and pairwise residue representations to accurately model the evolution of protein-protein interactions, despite training exclusively on individual chains.
Yo Akiyama, Zhidian Zhang, Olivia Tang et al.· Cell· 3 citations
It is found that many GigaRef singletons belong to a cluster under alternative parameter settings, suggesting that genomic and metagenomic datasets may require dataset-specific clustering configurations, and it is shown that singletons share mutual information with clustered sequences, making them learnable by PLMs and...
R. Vinod, Samir Char, Ava A. Amini et al.· bioRxiv· 0 citations
MAXWELL (Matrix-wise Landscape Learning), a novel post-training method that calibrates the probabilistic outputs learned by protein language models during pretraining to generate mutational landscapes that quantify the effects of individual amino acid substitutions on protein stability, is introduced.
Ming-Chen Li, Xiaoran Cheng, Fan Jiang et al.· bioRxiv· 0 citations
It is determined that portions of protein sequence space, despite being unobserved in nature, contains many functional proteins that cannot be predicted accurately in silico, providing experimental support for the hypothesis that natural protein sequences explored by evolution represent a miniscule fraction of all poss...
Nathan Diplock, Thomas A. Desautels, Riyaz Haque et al.· bioRxiv· 0 citations
This work developed a scoring-approach for AI-agents to autonomously assess AlphaGenome prediction confidence and accurately differentiate between AlphaGenome’s robust sequence-level recognition across species and its current limitations when interpreting un-fine-mapped regulatory variants.
Priya Ramarao-Milne, Suyu Ma, L. Sng et al.· bioRxiv· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.