Sourav Adhikari

The revival of bagged trees: hierarchical shrinkage as a regularization tool

We present methodological refinements and new insights into hierarchical shrinkage (HS), a post-hoc regularization technique for decision trees that shrinks node predictions toward ancestral means. By contrasting HS with the implicit regularization from feature sub-sampling in random forests (RFs), we clarify when bagg...