Do ResNets Route? Sparse Interaction Experts in Residual Networks
Residual networks execute every block for every input, yet their functional contributions need not be input independent. We formulate a trained ResNet as a set function over binary residual-branch masks and apply M\"obius inversion to decompose its output exactly into individual residual corrections and higher-order in...
Liang Yan, Si-Ying Chen, Kai-Jie Chen et al.
· 0 citations