Gradient Descent
Published:
Overview
Content from ISL Chapter study notes. Details coming soon.
Key Concepts
- Cost Function and Gradient
- Batch Gradient Descent
- Stochastic Gradient Descent (SGD)
- Learning Rate Selection
- Convergence Criteria
- Gradient Descent for Linear Regression Derivation
References
- James, G., Witten, D., Hastie, T., & Tibshirani, R. (2021). An Introduction to Statistical Learning (2nd ed.). Springer.