Esma Ulutas

A Novel Activation Function for Enhancing Deep Neural Network Stability and Performance

Activation functions play an important role in the performance of deep learning models by enabling them to learn complex and nonlinear relationships. However, widely used activation functions, such as ReLU, ELU, Swish, and GELU, have certain limitations. Issues such as exploding and vanishing gradients and dead neuro...