A trainable language model with potential to modulate translation rates in non-model organisms by generating upstream untranslated region sequence libraries
A simple generative approach for creating synthetic 5′-UTR libraries based solely on the genomic sequence statistics of any desired organism and demonstrates that simple statistical language model approaches applied to genomic data can generate functional translational regulatory sequence libraries without detailed mechanistic knowledge or explicit reference to consensus motifs.
Abstract
Tuning protein expression in non-model organisms is often constrained by the lack of validated genetic parts and predictive design tools. Translational tuning through the modulation of upstream untranslated regions (5′-UTRs) offers a potentially organism-agnostic route, but existing methods typically rely on mechanistic assumptions, prior knowledge that may not be available in non-model contexts, or the screening of sequence libraries. Here, we present a simple generative approach for creating synthetic 5′-UTR libraries based solely on the genomic sequence statistics of any desired organism. The method uses a sliding-window n-gram language model applied to native 5′-UTR sequences to produce novel sequences that preserve organism-specific base distributions and motifs without hard-coding specific motifs or mechanistic rules into inflexible statistical templates. We have applied this approach to the model bacterium Escherichia coli and the non-model probiotic Limosilactobacillus reuteri. Libraries of approximately 1,000 sequences were generated for each organism, from which about 100 unique sequences were experimentally tested for translation of a fluorescent reporter protein. In both organisms, the synthetic libraries yielded a broad range of translation levels from this relatively small number of tested variants. Sequences derived from an organism’s own genomic statistics provided a more uniformly distributed range of translation rates in that organism than sequences derived from the other species. Correlations of individual sequence performance across the two species were weak, and thermodynamic predictions of ribosome binding strength showed very little predictive power, especially in the non-model L. reuteri. The results demonstrate that simple statistical language model approaches applied to genomic data can generate functional translational regulatory sequence libraries without detailed mechanistic knowledge or explicit reference to consensus motifs. The approach requires minimal computational resources, avoids reproducing native sequences, and can be readily applied to any organism with a sequenced genome. This strategy may lower technical barriers to expression tuning in non-model organisms.
In vitro data showed that MLM-designed variants outperformed conventional and commercial-vendor-derived sequences in both transient and stably integrated expression, supporting the models’ ability to capture translational context beyond codon frequency.
Shushan Toneyan, Kerstin Scholz, C. de Donno et al.· bioRxiv· 0 citations
EPIC, the Eukaryotic Promoter and transcription Initiation prediction Challenge, relies on understudied animals spanning three phyla: octopus, oyster, milkweed bug, Indian meal moth, and shark and is open to everyone.
Ilya E. Vorontsov, N. Gryzunov, Bayley R. McDonald et al.· bioRxiv· 0 citations
GPN-Star substantially outperforms previous methods in prioritizing pathogenic and fine-mapped genome-wide association study variants, yields strong enrichments of complex trait heritability and improves power in rare variant association testing, which positions GPN-Star as a scalable, powerful and flexible tool for ge...
Cheng-Zhong Ye, Gonzalo Benegas, Carlos Albors et al.· Nature· 10 citations· ⚡1
A meta-model termed MetaTIS was implemented by combining outputs of genomic and protein language models fine-tuned on Ensembl annotations of transcripts and five different TIS datasets, which proficiently differentiates between spurious and true TIS in four distinct test sets, for both AUG and non-AUG instances.
Aram N. Papazian, Volkhard Helms· NAR Genomics and Bioinformat...· 0 citations
This work introduces ZEST (Zoned Encoding of Sequence Traits), an evolution-informed vocabulary derived from conserved regions of multiple sequence alignments that demonstrates that evolution-informed tokenization can substitute for massive parameter scaling, opening a new direction for efficient, biologically-grounded...
Biswajit Banerjee, C. A. Carreño, Anton S. Petrov· 0 citations
This work introduces LAMBDA, a benchmark designed to rigorously evaluate genome language model embeddings through phage-bacteria sequence discrimination across four categories of increasing complexity: probing tasks, fine-tuning assessments, diagnostic tests, and genome-wide prophage detection.
LeAnn M. Lindsey, Nicole L. Pershing, K. Dufault-Thompson et al.· NAR Genomics and Bioinformat...· 0 citations