A Specialized Evolutionary Strategy Using Mean Absolute Error Random Sampling to Design Recurrent Neural Networks

By Andrés Camero, Jamal Toutouh, Enrique Alba. 2019

16 citations recorded by the source corpus.

Recurrent neural networks have demonstrated to be good at solving prediction problems. However, finding a network that suits a problem is quite hard because of their high sensitivity to the hyperparameter configuration. Automatic hyperparameter optimization methods help to find the most suitable configuration, but they are not extensively adopted because of their high computational cost. In this work, we study the use of the mean absolute error random sampling to compare multiple-hidden-layer architectures and propose an evolutionary strategy-based algorithm that uses its results to optimize the configuration of a recurrent network. We empirically validate our proposal and show that it is possible to predict and compare the expected performance of a hyperparameter configuration in a low-cost way, as well as use these predictions to optimize the configuration of a recurrent network.

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

1. Bing Xue
2. Yanan Sun
3. Mengjie Zhang
4. Yuqiao Liu
5. Gary G. Yen
6. Yaochu Jin
7. Handing Wang
8. Ye Tian

Citations in the corpus

• A Survey on Evolutionary Neural Architecture Search (2020, background): “feedforward neural network, some ENAS methods concern about how many times the RNN should be unfold [44], [45].”