Author

Ali Ramezani-Kebrya

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

Intrinsic Information-Theoretic Analysis of ReLU Nets

Mutual information (MI) is fundamental to representation-learning analysis in deep networks, but in high dimensions MI estimators depend on hyperparameters whose bias often dominates the signal. We show that continuous piecewise-linear (CPWL) networks, including ReLU networks, admit an intrinsic information-theoretic a...

Johan Mylius-Kroken, Elisabeth Wetzer, Ali Ramezani-Kebrya et al. · 0 citations

#machine learning Preprint Nov 2026

Non-Parametric Mutual Information Estimation with Vine Copulas

This work introduces VINE, a flexible and computationally efficient MI estimator based on simplified D-vine copulas, and compares VINE against SotA neural MI estimators on a range of datasets, demonstrating competitive accuracy at a lower computational cost for low- to medium-dimensional datasets.

Sigurd Holmsen, Berit Omli Øksnes, Ingrid Hobæk Haff et al. · 0 citations