Optimization by Direct Search: New Perspectives on Some Classical and Modern Methods

By Tamara G. Kolda, Robert Michael Lewis, Virginia Torczon. 2003

1,825 citations recorded by the source corpus.

Subfields: Artificial Intelligence, Management Science and Operations Research, Numerical Analysis

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

1. Luís Nunes Vicente
2. Nikolaos V. Sahinidis
3. Rohollah Garmanjani
4. Louis J. Durlofsky
5. Jessica J. Fridrich
6. Vojtech Holub
7. Daniel E. Finkel
8. Jan Kodovský

In Management Science and Operations Research

1. Robert B. Gramacy
2. Zi Wang
3. Stefanie Sabrina Jegelka
4. Herbert K. H. Lee
5. M. Karimi-Fard
6. C. T. Kelley
7. Andreas R. Dengel
8. Bolei Zhou

In Numerical Analysis

1. Luís Nunes Vicente
2. Nikolaos V. Sahinidis
3. Luis Miguel Rios
4. Rohollah Garmanjani
5. Louis J. Durlofsky
6. D. Echeverría Ciaurri
7. Rommel G. Regis
8. Stefan M. Wild

Citations in the corpus

• Maximum-Likelihood Estimation With a Contracting-Grid Search Algorithm (2010, methodology): “We have developed a new algorithm that falls in the class of variable-mesh, derivative-free optimization (DFO) algorithms [5]–[ 7 ].”
• Mesh Adaptive Direct Search Algorithms for Constrained Optimization (2006, background): “Consider the unconstrained optimization problem inR2 presented in [16] where GPS algorithms are known to converge to non-stationary points:”
• A particle swarm pattern search method for bound constrained global optimization (2007, methodology): “But, since D� includes all such directions [ 26 ], we assume the use of this set throughout the remainder of the paper.”
• Black-Box Tuning for Language-Model-as-a-Service (2022, methodology): “Since gradients are unavailable, we can only invoke derivative-free optimization (DFO) 3 (Kolda et al., 2003; Conn et al., 2009; Rios & Sahinidis, 2013).”
• Rich Models for Steganalysis of Digital Images (2012, neutral): “compass search [31] that minimizes (10).”
• Use of reduced-order models in well control optimization (2017, methodology): “Directsearch methods that have been applied for well control optimization include generalized pattern search (Audet and Dennis Jr 2002; Kolda et al. 2003; Conn et al. 2009), mesh adaptive direct search (Audet and Dennis Jr 2006; Conn et al.”
• Determination of wheel–rail contact points with semianalytic methods (2008, methodology): “In some preceding works [10, 11], the authors presented some procedures to find numerically the minima, based on iterative methods (namely Simplex method and Compass search [12, 13]).”
• Modeling an augmented Lagrangian for improved blackbox constrained optimization (2014, methodology): “In the unconstrained context, Gray et al. (2007) and Taddy et al. (2009) have had success pairing EI with the APPS direct search method (Kolda et al., 2003).”
• Benchmarking Derivative-Free Optimization Algorithms (2009, background): “There is no guarantee of convergence in this case since the current convergence theory for derivative-free optimization algorithms (see, for example, [2, 11]) assumes that f is differentiable.”