Lightweight Redesign of Long-Used Operators in Vision Backbones for Efficient Visual Recognition
Recent vision backbones increasingly rely on sophisticated modules, whereas long-used operators such as residual connections, activations, and normalization layers remain less explored for lightweight redesign. This paper revisits these operators and proposes three operator-level redesigns: Subtractive Residual Connect...