Adriano Fagiolini

Runtime-Incremental Transformer for Reinforcement-Learning-Based Adaptive Control

A runtime mechanism that grows and prunes the heads of the attention block during reinforcement learning, governed by two signals: the effective rank of the on-policy context distribution, which triggers growth when representational capacity becomes insufficient, and the per-head output magnitude, which flags redundant...