On Generalisation Error Bounds for Transformers
This paper establishes a collection of covering number bounds for linear function classes under various norm constraints on the inputs and matrices and explicitly incorporates rank constraints on the underlying matrix classes, allowing us to characterize how low-rank structures affect the metric entropy.