GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulators

By Philipp Wu, Yide Shentu, Zhongke Yi, Xingyu Lin, Pieter Abbeel. IEEE/RJS International Conference on Intelligent RObots and Systems, 2023

342 citations recorded by the source corpus.

Humans can teleoperate robots to accomplish complex manipulation tasks. Imitation learning has emerged as a powerful framework that leverages human teleoperated demonstrations to teach robots new skills. However, the performance of the learned policies is bottlenecked by the quality, scale, and variety of the demonstration data. In this paper, we aim to lower the barrier to collecting large and high-quality human demonstration data by proposing a GEneraL framework for building LOw-cost and intuitive teleoperation systems for robotic manipulation (GELLO). Given a target robot arm, we build a GELLO controller device that has the same kinematic structure as the target arm, leveraging 3D-printed parts and economical off-the-shelf motors. GELLO is easy to build and intuitive to use. Through an extensive user study, we show that GELLO enables more reliable and efficient demonstration collection compared to other cost efficient teleoperation devices commonly used in the imitation learning literature such as virtual reality controllers and 3D spacemouses. We further demonstrate the capabilities of GELLO for performing complex bi-manual and contact-rich manipulation tasks. To make GELLO accessible to everyone, we have designed and built GELLO systems for 3 commonly used robotic arms: Franka, UR5, and xArm. All software and hardware are open-sourced and can be found on our website: https://wuphilipp.github.io/gello/.

Subfields: Control and Systems Engineering, Industrial and Manufacturing Engineering, Mechanical Engineering

View Paper: https://www.semanticscholar.org/paper/f33b10bf19db13bca22b4bd13963ecbcedc739f3

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Control and Systems Engineering

In Industrial and Manufacturing Engineering

In Mechanical Engineering

Russ Tedrake

Citations in the corpus

Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robots (2024, background): “While recent advancements in leader-follower (i.e. puppetting) devices such as ALOHA [53, 15] and GELLO [46] offer promise with intuitive and low-cost interfaces, their reliance on real robots during data collection limits the type and number of environments the system can gain access to for…”
Open-TeleVision: Teleoperation with Immersive Active Visual Feedback (2024, positive): “There are also more conventional frameworks exploiting exo-skeleton devices [11] or mirroring arms for joint copy [10, 12, 13].”