Coordinated Multi-Agent Imitation Learning

By Hoang Minh Le, Yisong Yue, Peter Carr, Patrick Lucey. 2017

212 citations recorded by the source corpus.

We study the problem of imitation learning from demonstrations of multiple coordinating agents. One key challenge in this setting is that learning a good model of coordination can be difficult, since coordination is often implicit in the demonstrations and must be inferred as a latent variable. We propose a joint approach that simultaneously learns a latent coordination model along with the individual policies. In particular, our method integrates unsupervised structure learning with conventional imitation learning. We illustrate the power of our approach on a difficult problem of learning multiple policies for finegrained behavior modeling in team sports, where different players occupy different roles in the coordinated team strategy. We show that having a coordination model to infer the roles of players yields substantially improved imitation loss compared to conventional baselines.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Economics and Econometrics, LLM Agents & Tool Use, Reinforcement Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Sergey Levine
  2. Pieter Abbeel
  3. Li Fei-Fei
  4. Chelsea Finn
  5. Yoshua Bengio
  6. Ruslan Salakhutdinov
  7. Mohit Bansal
  8. Trevor Darrell

In Computer Vision and Pattern Recognition

  1. Dacheng Tao
  2. Luc Van Gool
  3. Trevor Darrell
  4. Li Fei-Fei
  5. Kristen Grauman
  6. Jitendra Malik
  7. Xiaogang Wang
  8. Ming-Hsuan Yang

In Economics and Econometrics

  1. Zongqing Lu
  2. Jiechuan Jiang
  3. Bangwei Li
  4. Yongyuan Liang
  5. Yi Cai
  6. Hongyuan Zha
  7. Klaus-Jürgen Diepold
  8. Silvio Savarese

In LLM Agents & Tool Use

  1. Bangwei Li
  2. Yongyuan Liang
  3. Maruan Al-Shedivat
  4. Harrison Edwards
  5. Hongyuan Zha
  6. Klaus-Jürgen Diepold
  7. Jonathan P. How
  8. Sergey Levine

In Reinforcement Learning

  1. Sergey Levine
  2. Pieter Abbeel
  3. Chelsea Finn
  4. Silvio Savarese
  5. Li Fei-Fei
  6. Tengyu Ma
  7. Yuke Zhu
  8. Roberto Mart'in-Mart'in

Citations in the corpus