Riccati State Space Models: Non-iterative Parallelization for Nonlinear Sequence Modeling
RiccatiSSM, a nonlinear SSM, in which each state dimension follows an input-conditioned Riccati differential equation, is introduced, demonstrating that state-dependent nonlinear dynamics can retain exact composability and be evaluated efficiently within a single parallel scan.
Mónika Farsang, Ramin M. Hasani, Daniela Rus et al.
· 0 citations