Sim-to-Real Transfer of Robotic Control with Dynamics Randomization

By Xue Bin Peng, Marcin Andrychowicz, Wojciech Zaremba, Pieter Abbeel. 2017

1,765 citations recorded by the source corpus.

Simulations are attractive environments for training agents as they provide an abundant source of data and alleviate certain safety concerns during the training process. But the behaviours developed by agents in simulation are often specific to the characteristics of the simulator. Due to modeling error, strategies that are successful in simulation may not transfer to their real world counterparts. In this paper, we demonstrate a simple method to bridge this “reality gap”. By randomizing the dynamics of the simulator during training, we are able to develop policies that are capable of adapting to very different dynamics, including ones that differ significantly from the dynamics on which the policies were trained. This adaptivity enables the policies to generalize to the dynamics of the real world without any training on the physical system. Our approach is demonstrated on an object pushing task using a robotic arm. Despite being trained exclusively in simulation, our policies are able to maintain a similar level of performance when deployed on a real robot, reliably moving an object to a desired location from random initial configurations. We explore the impact of various design decisions and show that the resulting policies are robust to significant calibration error.

Subfields: Artificial Intelligence, Control and Systems Engineering, Robotics & Control

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Sergey Levine
  2. Pieter Abbeel
  3. Chelsea Finn
  4. Yoshua Bengio
  5. Mohit Bansal
  6. Ruslan Salakhutdinov
  7. Trevor Darrell
  8. Quoc V. Le

In Control and Systems Engineering

  1. Sergey Levine
  2. Pieter Abbeel
  3. Chelsea Finn
  4. Vikash Kumar
  5. Abhishek Gupta
  6. Abhinav Kumar Gupta
  7. Dieter Fox
  8. Li Fei-Fei

In Robotics & Control

  1. Sergey Levine
  2. Pieter Abbeel
  3. Chelsea Finn
  4. Abhinav Kumar Gupta
  5. Vikash Kumar
  6. Dieter Fox
  7. Li Fei-Fei
  8. Silvio Savarese

Citations in the corpus