Riemannian Structure and Optimization for a Class of Low-Parametric Orthogonal Matrices
In this paper, we are concerned with matrices formed by block-diagonal factors interleaved with fixed permutations -- a flexible family of structured matrices. This class has recently drawn interest in deep learning architectures for its balanced expressivity-efficiency trade-off, yet efficient computational strategies...
Aliev S. E. Aliev, Maxim V. Rakhuba
· 0 citations