Verifying my understanding of MLE & Gradient Descent in Logistic Regression

Here is my understanding of the relation between MLE Gradient Descent in Logistic Regression. Please correct me if I'm wrong:

1) MLE estimates optimal parameters by taking the partial derivative of the log-likelihood function wrt. each parameter equating it to 0. Gradient Descent just like MLE gives us the optimal parameters by taking the partial derivative of the loss function wrt. each parameter. GD also uses hyperparameters like learning rate step size in the process of obtaining parameter values.

2) MLE is analytical/exact whereas GD is numerical/approximate. Unfortunately, MLE in Logistic Regression cannot give an exact solution, unless we have a small sample of data with one or two independent variables. So in Logistic Regression, we use both methods to find the best values of parameters. We take the negative of the log-likelihood function that we obtain through MLE as a loss function use it in GD to get parameter values.

Topic parameter-estimation gradient-descent logistic-regression

Category Data Science


2) is Wrong. MLE stands for Maximum likelihood estimation. Not an analytical method.

About

Geeks Mental is a community that publishes articles and tutorials about Web, Android, Data Science, new techniques and Linux security.