Learning dexterous in-hand manipulation

By Marcin Andrychowicz, Bowen Baker, Maciek Chociej, Rafal Józefowicz, Bob McGrew, Jakub W. Pachocki, Arthur Petron, Matthias Plappert, Glenn Powell, Alex Ray and 6 more. 2018

2,231 citations recorded by the source corpus.

We use reinforcement learning (RL) to learn dexterous in-hand manipulation policies that can perform vision-based object reorientation on a physical Shadow Dexterous Hand. The training is performed in a simulated environment in which we randomize many of the physical properties of the system such as friction coefficients and an object’s appearance. Our policies transfer to the physical robot despite being trained entirely in simulation. Our method does not rely on any human demonstrations, but many behaviors found in human manipulation emerge naturally, including finger gaiting, multi-finger coordination, and the controlled use of gravity. Our results were obtained using the same distributed RL system that was used to train OpenAI Five. We also include a video of our results: https://youtu.be/jwSbzNHGflM.

Subfields: Artificial Intelligence, Control and Systems Engineering, Mechanical Engineering, Reinforcement Learning, Robotics & Control

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Sergey Levine
  2. Pieter Abbeel
  3. Yoshua Bengio
  4. Chelsea Finn
  5. Ruslan Salakhutdinov
  6. Mohit Bansal
  7. Quoc V. Le
  8. Trevor Darrell

In Control and Systems Engineering

  1. Sergey Levine
  2. Pieter Abbeel
  3. Chelsea Finn
  4. Vikash Kumar
  5. Abhishek Gupta
  6. Abhinav Kumar Gupta
  7. Silvio Savarese
  8. Li Fei-Fei

In Mechanical Engineering

  1. Sergey Levine
  2. Pieter Abbeel
  3. Chelsea Finn
  4. Vikash Kumar
  5. Shixiang Shane Gu
  6. Igor Mordatch
  7. Aravind Rajeswaran
  8. Ofir Nachum

In Reinforcement Learning

  1. Sergey Levine
  2. Pieter Abbeel
  3. Chelsea Finn
  4. Ofir Nachum
  5. Shimon Whiteson
  6. Shixiang Shane Gu
  7. Yuxi Li
  8. Aviral Kumar

In Robotics & Control

  1. Sergey Levine
  2. Pieter Abbeel
  3. Chelsea Finn
  4. Silvio Savarese
  5. Abhinav Kumar Gupta
  6. Vikash Kumar
  7. Li Fei-Fei
  8. Dieter Fox

Citations in the corpus