Ryuichi Kanoh

Double Descent in Gradient Boosting Decision Trees via Split-Candidate Scaling

Double descent is commonly studied by scaling an explicit capacity parameter, such as neural-network width. For gradient boosting decision trees (GBDTs), however, an analogous single-axis capacity parameter has not been established. We propose the number of split candidates as an operational capacity parameter for GBDT...