Shreya Sajid

AudioTETRIS: Token Elimination via Transitional Importance Signals for Efficient Audio LLMs

Large Audio Language Models (LALMs) achieve strong performance on speech-text tasks, but standard audio encoders produce hundreds of tokens for even short audio clips. Because self-attention scales quadratically in sequence length, this inflates inference-time compute substantially. Current training-free token compress...