ParamILS: An Automatic Algorithm Configuration Framework

By Frank Hutter, Holger H. Hoos, Kevin Leyton-Brown, Thomas Stützle. 2014

1,129 citations recorded by the source corpus.

The identification of performance-optimizing parameter settings is an important part of the development and application of algorithms. We describe an automatic framework for this algorithm configuration problem. More formally, we provide methods for optimizing a target algorithm's performance on a given class of problem instances by varying a set of ordinal and/or categorical parameters. We review a family of local-search-based algorithm configuration procedures and present novel techniques for accelerating them by adaptively limiting the time spent for evaluating individual configurations. We describe the results of a comprehensive experimental evaluation of our methods, based on the configuration of prominent complete and incomplete algorithms for SAT. We also present what is, to our knowledge, the first published work on automatically configuring the CPLEX mixed integer programming solver. All the algorithms we considered had default parameter settings that were manually identified with considerable effort. Nevertheless, using our automated algorithm configuration procedures, we achieved substantial and consistent performance improvements.

Subfields: Computational Theory and Mathematics, Computer Networks and Communications, Neural Architecture Search & AutoML

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computational Theory and Mathematics

  1. Frank Hutter
  2. Ponnuthurai Nagaratnam Suganthan
  3. Holger H. Hoos
  4. Marco F. Huber
  5. Marc-André Zöller
  6. Yaochu Jin
  7. Xin Yao
  8. Marius Thomas Lindauer

In Computer Networks and Communications

  1. Frank Hutter
  2. Holger H. Hoos
  3. Kevin Leyton-Brown
  4. Yuri Malitsky
  5. Katharina Eggensperger
  6. Lars Kotthoff
  7. Marius Thomas Lindauer
  8. Chris J. Thornton

In Neural Architecture Search & AutoML

  1. Frank Hutter
  2. Holger H. Hoos
  3. Kevin Leyton-Brown
  4. Matthias Feurer
  5. Gang Luo
  6. Marc-André Zöller
  7. Marco F. Huber
  8. Marius Thomas Lindauer

Citations in the corpus