Is this XGBoost model tending to overfit?
Here is the list of hyperparameters that I used:
params = {
'scale_pos_weight': [1.0],
'eta': [0.05, 0.1, 0.15, 0.9, 1.0],
'max_depth': [1, 2, 6, 10, 15, 20],
'gamma': [0.0, 0.4, 0.5, 0.7]
}
The dataset is imbalanced so I used scale_pos_weight parameter.
After 5 fold cross validation the f1 score that I got is: 0.530726530426833
Topic hyperparameter-tuning overfitting xgboost hyperparameter dataset
Category Data Science