Analysis of Transformer models on ENCODE cis-regulatory sequences with Adam and Muon indicates that optimizer update structure and norm-control choices are practical levers for reducing the training resources required to reach matched perplexity targets in regulatory DNA pretraining.
Alongside the bottlenecks of this approach discussed here, used as a decision aid, prediction-guided construct and protocol design has the potential to remove costly iteration cycles of protein production campaigns.
It is suggested that progress requires reframing seq2func models as continually refined systems, in which targeted perturbation experiments, systematic evaluation and iterative model updates are tightly coupled through artificial intelligence-experiment feedback loops, enabling self-improving models that progressively...
Masayuki Nagai, A. E. Murphy, Kaeli Rizzo et al.· Nature Genetics· 2 citations
BINND is developed, a binding and interaction neural network to predict non-orthogonal DNA interactions, which could aid diagnostic, bioengineering, and DNA origami design, and supporting a shift toward exploiting the full sequence space.
Karishma Matange, Gunavaran Brihadiswaran, Kyle J. Tomek et al.· Nature Communications· 0 citations
This tutorial provides a comprehensive, end-to-end workflow from raw data to deployed models,icitly designed for environmental chemists with limited prior experience in ML modeling while also providing practical guidance for other users seeking to strengthen their modeling workflows.
Kai Zhang, Yu-Shu Cheng, Hai-Ping Ai et al.· ACS Environmental Au· 0 citations
This work introduces seqme, a modular and highly extendable open-source Python library, containing model-agnostic metrics for evaluating computational methods for biological sequence design, and can be used to evaluate both one-shot generation and iterative optimization.
Rasmus Møller-Larsen, Adam Izdebski, Jan Olszewski et al.· Bioinformatics Advances· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.