Charalampos Koilakos

Accelerating inference in genomic and proteomic foundation models via speculative decoding

Abstract Motivation Genomic and protein foundation models (GFMs and PFMs) have demonstrated strong performance in learning the language of DNA and proteins, but their use in large-scale sequence generation is limited by the latency of autoregressive decoding. Because every token triggers a forward pass of a large Trans...