Stability and Generalization of Straight-Through Estimators for Training Two-Layer Quantized Neural Networks
We study the identity straight-through estimator (STE) for training a two-layer binary-activation network with hinge loss from the perspective of Statistical Learning Theory (SLT). Our central question is whether algorithmic stability can explain the statistical generalization of the estimator produced by the discontin...