Efficient biological design via genomic in-context learning
TL;DR
It is shown that ICL emerges in the genome language model Evo 2 and enables biological design and is established as a versatile and efficient paradigm for biological sequence design.
Abstract
In-context learning (ICL), the ability to perform new tasks from a few examples supplied in a prompt, is a defining emergent capability of large language models. Here, we show that ICL emerges in the genome language model Evo 2 and enables biological design. With as few as four examples in the prompt and no additional training, Evo 2 generates realistic metal-binding proteins, de novo antibodies, protein-RNA systems, and entire bacteriophage genomes. For ΦX174-like bacteriophage design, ICL surpasses previously fine-tuned models on computational measures of design quality and diversity. Beyond ΦX174, conditioning the model with different phage prompts enables us to efficiently design MS2 and M13 genomes in silico without fine-tuning. Iteratively updating the prompt with newly generated phage genomes, which we refer to as genomic chain-of-thought, further improves the diversity of designs while maintaining quality metrics. Paired with an inference engine that accelerates generation up to 35-fold and extends practicable context to a megabase, these results establish ICL as a versatile and efficient paradigm for biological sequence design.
