A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms

By Joaquín Derrac, Salvador Garcia, Daniel Molina, Francisco Herrera. Swarm and Evolutionary Computation, 2011

5,200 citations recorded by the source corpus.

Subfields: Artificial Intelligence, Computational Theory and Mathematics

View Paper: https://www.semanticscholar.org/paper/eeea4322184e54f04f79263eda451cb4272b8ee4

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

In Computational Theory and Mathematics

Citations in the corpus

Recent Trends in the Use of Statistical Tests for Comparing Swarm and Evolutionary Computing Algorithms: Practical Guidelines and a Critical Review (2020, methodology): “[36] Non-parametric - Optimisation Tutorial on the use of non-parametric tests and post-hoc procedures.”
A Multiobjective Evolutionary Algorithm Based on Decision Variable Analyses for Multiobjective Optimization Problems With Large-Scale Variables (2016, methodology): “Due to the randomness in MOEAs, statistical test procedures [47] are necessary to contrast the results obtained by optimization algorithms.”
Evolutionary algorithms for hyperparameter tuning on neural networks models (2014, methodology): “In order to assess if the differences between proposed methods are significant, we have executed a Friedman test with Hochberg’s and Bergmann’s post hoc analyses (Demšar 2006; Derrac et al. 2011; Bergmann and Hommel 1988).”
RUN beyond the metaphor: An efficient optimization algorithm based on Runge Kutta method (2021, methodology): “The Friedman and Quade tests (Derrac, et al., 2011) were conducted to determine the six optimizers' influential performances.”
A Comprehensive Analysis of Deep Regression (2018, positive): “Following the recommendation of Derrac et al. [66], in this paper we use the Holm procedure to control the FWER.”
Study of the impact of resampling methods for contrast pattern based classifiers in imbalanced databases (2016, neutral): “statistical differences in their results [71,72].”
The Ant Lion Optimizer (2015, methodology): “Due to the stochastic nature of the algorithms, however, statistical test should also be conducted [67].”
Transforming geocentric cartesian coordinates to geodetic coordinates by using differential search algorithm (2012, methodology): “For the statistical tests performed, H0:Common Median1⁄40 (Wang et al., 2011 ; Wenyin et al., 2011; Derrac et al., 2011).”