Introduction to Optimization

By Xin-She Yang, J. Kiusalaas, Xing He. 2015

2,855 citations recorded by the source corpus.

Plain gradient descent (2:1) Stepsize and step direction as core issues (2:2) Stepsize adaptation (2:4) Backtracking (2:5) Line search (2:5) Wolfe conditions (2:7) Gradient descent convergence (2:8) Steepest descent direction (2:11) Covariant gradient descent (2:13) Newton direction (2:14) Newton method (2:15) Gauss-Newton method (2:20) Quasi-Newton methods (2:23) Broyden-Fletcher-Goldfarb-Shanno (BFGS) (2:25) Conjugate gradient (2:28) Rprop (2:35)

Subfields: Numerical Analysis, Optimization & Training

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Numerical Analysis

  1. Nicolas Loizou
  2. Peter Richtárik
  3. Simon Lacoste-Julien
  4. Issam Hadj Laradji
  5. Sebastian U. Stich
  6. Ernö Robert Csetnek
  7. Sharan Vaswani
  8. Jakub Konecný

In Optimization & Training

  1. Nicolas Loizou
  2. Peter Richtárik
  3. Simon Lacoste-Julien
  4. Sebastian U. Stich
  5. Jakub Konecný
  6. Martin Jaggi
  7. Francis R. Bach
  8. Sashank J. Reddi

Citations in the corpus