Programming AMD XDNA NPUs with Open-source Compiler Tools: A FlashAttention Case Study
This work compares four reference designs on XDNA 1 and XDNA 2: one runs each operator separately, two stream between operators on chip, and one fuses all three attention stages into a single kernel, which covers twelve LLM configurations, from BERT to DeepSeek, up to 128K tokens.