Parameter-Level Attribution of Symmetry in Trained Networks Though Parameter-Wise Functional Sensitivity
When a network has learned a function with a known symmetry, can that symmetry be moved through the parametrisation---is there a motion in parameter space realising the group action in function space? We formulate this as a lifting problem for the realisation map $\Phi:\theta\mapsto f_\theta$, and show that a smooth pa...