Notebook comparing several optimization algorithms to find the minimum of the Rosenbrock function:
- Newton's method
- Gradient descent (fixed learning rate)
- Gradient descent (adaptative learning rate, using line search methods)
- Golden section search
- Wolfe method
- BFGS
- DFP
- Conjugate Gradient method