Beyond Affine Transformations: A Soft Dominance Layer for Coordinate-Wise Neural Computation
This paper presents a preliminary study of an alternative to the affine transformation underlying conventional neural-network layers. In the proposed Soft Dominance Layer, each output unit compares input coordinates with a learnable reference vector and aggregates smooth inequality responses. A sigmoid relaxation makes...
Mariano Rivera
· 0 citations