Li-Xing Li

NGN: Learning Neural Network Size as a Differentiable Count

Neural network size is usually chosen before training, separating architecture selection from weight optimization. We introduce the Neurogenesis Network (NGN), a differentiable parameterization for learning how many ordered structural components a model should use. For each ordered component group, one learnable bounda...