Online Object and Task Learning via Human Robot Interaction

By Masood Dehghan, Mennatullah Siam, Jun Jin, Laura C. Petrich, Martin Jägersand. 2018

33 citations recorded by the source corpus.

This work describes the development of a robotic system that acquires knowledge incrementally through human interaction where new objects and motions are taught on the fly. The robotic system developed was one of the five finalists in the KUKA Innovation Award competition and demonstrated during the Hanover Messe 2018 in Germany. The main contributions of the system are i) a novel incremental object learning module - a deep learning based localization and recognition system - that allows a human to teach new objects to the robot, ii) an intuitive user interface for specifying 3D motion task associated with the new object, and iii) a hybrid force-vision control module for performing compliant motion on an unstructured surface. This paper describes the implementation and integration of the main modules of the system and summarizes the lessons learned from the competition.

Subfields: Aerospace Engineering, Control and Systems Engineering

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Aerospace Engineering

  1. Ali Ayub
  2. Alan R. Wagner

In Control and Systems Engineering

  1. Ali Ayub
  2. Alan R. Wagner
  3. C. Fendley

Citations in the corpus