If There is a case where decision trees are getting overfitted so by using gradient boost method do we solve that problem?

I have came across a case where my decision trees are getting overfitting so by using methods like gradient boost can I solve that problem.

Topic ensemble-learning boosting machine-learning

Category Data Science


If your trees are overfitting you should probably check the hyperparameters of the tree. You shouldn't let the tree have leaves with too few samples, for example, since that would mean that the tree is memorizing every possible outcome of the training set, in other words, it's overfitting.

Maybe if you share some more information of your case we could help a little further, but I think you now at least have something to check.

Hope this helps!

About

Geeks Mental is a community that publishes articles and tutorials about Web, Android, Data Science, new techniques and Linux security.