Simultaneous analysis of approximate leave-one-out cross-validation and mean-field inference II: General convex penalties
For smooth penalties and group Lasso, Part I (https://arxiv.org/abs/2501.02624) analyzed approximate leave-one-out (ALO) cross-validation by comparing its weights with the trace correction used in mean-field inference. For a $C^2$ penalty $R$, the matrix entering these corrections is $A=[\nabla^2R(\widehat b)+X^TDX]^{-...