Open access
Sep 2026
A Novel Weight Initialization Scheme for Randomized Leaky Rectified Linear Units and a Comparative Analysis of Rectified Activation Functions for Image Classification
This study proposes a novel weight initialization scheme specifically designed for the randomized leaky rectified linear unit (RReLU) activation function, with the objective of preserving signal statistics during both forward and backward propagation.
M. Turhan, Emrah Dönmez
· Electronics · 0 citations