Nickvash Kani

Fisher8: Stabilizing Neural Heteroscedastic Regression via Output-Layer Fisher Geometry

Training neural networks to jointly predict mean and uncertainty estimates from noisy observations can be unstable, prompting a series of independent stabilization efforts. We argue that these interventions highlight a common underlying issue where gradient steps are poorly aligned with the geometry of the loss landsca...