Structure over Depth: A Single-Block Spatio-Temporal Transformer for Multi-Entity Reasoning
This work decomposes multi-entity temporal dynamics into three interaction types: spatial interactions among entities, temporal interactions across time, and cross interactions coupling the two domains, and proposes a structured spatio-temporal transformer block that explicitly models all three within a single stage.