Symmetry Detection and Exploitation for Function Approximation in Deep RL
By Anuj Mahajan, Theja Tulabandhula. 2017
12 citations recorded by the source corpus.
With recent advances in the use of deep networks for complex reinforcement learning (RL) tasks which require large amounts of training data, ensuring sample efficiency has become an important problem. In this work we introduce a novel method to detect environment symmetries using reward trails observed during episodic experience. Next we provide a framework to incorporate the discovered symmetries for functional approximation to improve sample efficiency. Finally, we show that the use of potential based reward shaping is especially effective for our symmetry exploitation mechanism. Experiments on classical problems show that our method improves the learning performance significantly by utilizing symmetry information.
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
- Tabish Rashid
- Shimon Whiteson
- Anuj Mahajan
- Mikayel Samvelyan
- Matthew R. Fellows
- Tonghan Wang
- Christian Schröder de Witt
- Tim G. J. Rudner
Citations in the corpus
- MAVEN: Multi-Agent Variational Exploration (2019, background): “RL[33] (by increasing sample inefficiency[31, 30]), but also by interacting with the representational constraints necessary for decentralisation to push the algorithm towards suboptimal policies.”
- VIREL: A Variational Inference Framework for Reinforcement Learning (2018, methodology): “[39] Mahajan, A.”