On the Relationships between Generative Encodings, Regularity, and Learning Abilities when Evolving Plastic Artificial Neural Networks
By Paul Tonelli, Jean-Baptiste Mouret. 2013
37 citations recorded by the source corpus.
A major goal of bio-inspired artificial intelligence is to design artificial neural networks with abilities that resemble those of animal nervous systems. It is commonly believed that two keys for evolving nature-like artificial neural networks are (1) the developmental process that links genes to nervous systems, which enables the evolution of large, regular neural networks, and (2) synaptic plasticity, which allows neural networks to change during their lifetime. So far, these two topics have been mainly studied separately. The present paper shows that they are actually deeply connected. Using a simple operant conditioning task and a classic evolutionary algorithm, we compare three ways to encode plastic neural networks: a direct encoding, a developmental encoding inspired by computational neuroscience models, and a developmental encoding inspired by morphogen gradients (similar to HyperNEAT). Our results suggest that using a developmental encoding could improve the learning abilities of evolved, plastic neural networks. Complementary experiments reveal that this result is likely the consequence of the bias of developmental encodings towards regular structures: (1) in our experimental setup, encodings that tend to produce more regular networks yield networks with better general learning abilities; (2) whatever the encoding is, networks that are the more regular are statistically those that have the best learning abilities.
Subfields: Artificial Intelligence, Electrical and Electronic Engineering
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Paul Tonelli
- Jean-Baptiste Mouret
- Kenneth O. Stanley
- Jeff Clune
- Joel Lehman
- Sebastian Risi
- Alan D. Blair
- Oliver J. Coleman
In Electrical and Electronic Engineering
Citations in the corpus
- Artificial Evolution of Plastic Neural Networks: A Few Key Concepts (2014, methodology): “Using this method, Tonelli and Mouret [28, 29] showed that a very regular mapbased encoding proposed in [13] have a TLA-level or 1 or 2.”