XGBoosting Home | About | Contact | Examples

Regularization

Helpful examples for the regularization while training XGBoost models.

Regularization in XGBoost often involves adding penalty terms to the objective function to control the model’s complexity, prevent overfitting, and enhance generalization by discouraging overly complex or large models.

ExamplesTags
Configure XGBoost "alpha" Parameter
Configure XGBoost "early_stopping_rounds" Parameter
Configure XGBoost "eval_metric" Parameter
Configure XGBoost "eval_set" Parameter
Configure XGBoost "iteration_range" Parameter for predict()
Configure XGBoost "lambda" Parameter
Configure XGBoost "reg_alpha" Parameter
Configure XGBoost "reg_lambda" Parameter
Configure XGBoost Dart "normalize_type" Parameter
Configure XGBoost Dart "one_drop" Parameter
Configure XGBoost Dart "rate_drop" Parameter
Configure XGBoost Dart "sample_type" Parameter
Configure XGBoost Dart "skip_drop" Parameter
Configure XGBoost Dropout Regularization (Dart)
Configure XGBoost Early Stopping Regularization
Configure XGBoost Early Stopping Tolerance
Configure XGBoost Early Stopping Via Callback
Configure XGBoost L1 Regularization
Configure XGBoost L2 Regularization
How to Use XGBoost EarlyStopping Callback
Tune XGBoost "early_stopping_rounds" Parameter
XGBoost "best_iteration" Property
XGBoost "best_score" Property
XGBoost "evals_result()" Method
XGBoost Early Stopping Get Best Model
XGBoost Early Stopping Get Best Round (Iteration)
XGBoost Early Stopping Report Verbose Output
XGBoost Early Stopping With Cross-Validation
XGBoost Early Stopping With Grid Search
XGBoost Early Stopping With Random Search
XGBoost Regularization Techniques
XGBoost Robust to Small Datasets