#artificial intelligence
Sep 2026
The Geometry of Logic: Stratification Induces Semantic Structure and Robust Reasoning
STRAT is introduced, which partitions the residual stream into orthogonal Data and Type subspaces and uses Type-based attention and gating to govern Data transformations and in arithmetic, STRAT reduces median OOD error 35-fold relative to a Transformer baseline.
Cristina V. Lopes, Yuan-Gang Li, Justin Tian Jin Chen et al.
· arXiv.org · 0 citations