Machine and Deep Learning

Gradient Descent

• Optimization algorithm used to find the values of parameters (coefficients) of a function (f) that minimizes a cost of function (cost).
• Used best when the parameters cannot be calculated analytically (linear algebra) and must be searched for by an optimization algorithm.