How to Train a Dragon: Hyperparameter Tuning for Gradient Boosting Without Overfitting

With boosted decision tree algorithms, such as XGBoost, CatBoost, and LightBoost, you may outperform other models, but overfitting is a…