Challenges in Task Incremental Learning for Assistive Robotics

By Rosa H. M. Chan, Xuesong Shi, Yimin Zhang, Qi She. 2020

37 citations recorded by the source corpus.

Recent breakthroughs in computer vision areas, ranging from detection, segmentation, to classification, rely on the availability of large-scale representative training datasets. Yet, robotic vision poses new challenges towards applying visual algorithms developed from these datasets because the latter implicitly assume a fixed set of categories and time-invariant distribution of tasks. In practice, assistive robots should be able to operate in dynamic environments with everyday changes. The variations of four commonly observed factors, including illumination, occlusion, camera-object distance/angles and clutter, could make lifelong/continual learning in computer vision more challenging. Large-scale datasets previously made publicly available were relatively simple, and rarely include such real-world challenges in data collection. Benefited from the recent released OpenLORIS-Object dataset, which explicitly includes these real-world challenges in the lifelong object recognition task, we evaluate three most adopted regularization methods in lifelong/continual learning (Learning without Forgetting, Elastic Weights Consolidation, and Synaptic Intelligence). Their performances were compared with the naive and cumulative training modes as the lower bound and upper bound of performances, respectively. The experiments conducted on the dataset focused on task incremental learning, i.e., incremental difficulty based on the four environment of factors. However, all the three most reported lifelong/continual learning algorithms have failed with the increase in encountered batches across various metrics with indistinguishable performance comparing to the naive training mode. Our results highlight the current challenges in lifelong object recognition for assistive robots to operate in real-world dynamic scene.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

In Computer Vision and Pattern Recognition

Citations in the corpus

Self-Supervised Training Enhances Online Continual Learning (2021, background): “, continual object detection [1, 62], continual semantic segmentation [11, 48], or continual learning for robotics applications [23, 37].”
Selective Replay Enhances Learning in Online Continual Analogical Reasoning (2021, background): “Continual learning has also been studied for object detection [2, 76], semantic segmentation [14, 59], and robotics [24, 50].”
Are We Ready for Service Robots? The OpenLORIS-Scene Datasets for Lifelong SLAM (2019, background): “With proper annotation, it could serve as a benchmark of incremental learning algorithms [23][24], enabling robots to keep learning new tasks.”