Game Engine Learning from Video
By Matthew J. Guzdial, Boyang Albert Li, Mark O. Riedl. 2017
51 citations recorded by the source corpus.
Intelligent agents need to be able to make predictions about their environment. In this work we present a novel approach to learn a forward simulation model via simple search over pixel input. We make use of a video game, Super Mario Bros., as an initial test of our approach as it represents a physics system that is significantly less complex than reality. We demonstrate the significant improvement of our approach in predicting future states compared with a baseline CNN and apply the learned model to train a game playing agent. Thus we evaluate the algorithm in terms of the accuracy and value of its output model.
Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Sergey Levine
- Chelsea Finn
- Quoc V. Le
- Pieter Abbeel
- Yoshua Bengio
- Mohit Bansal
- Ruslan Salakhutdinov
- Trevor Darrell
In Computer Vision and Pattern Recognition
- Luc Van Gool
- Sergey Levine
- Dacheng Tao
- Trevor Darrell
- Jitendra Malik
- Xiaogang Wang
- Ming-Hsuan Yang
- Bernt Schiele
Citations in the corpus
- Model-Based Reinforcement Learning for Atari (2019, methodology): “ke this, there are works in which modeling is more explicit, for example Ersen & Sariel (2014) uses testbed of the Incredible Machines to learn objects behaviors and their interactions. Similarly Guzdial et al. (2017) learns an engine predicting interactions of predefined set of sprites in the do”
- Recurrent World Models Facilitate Policy Evolution (2018, methodology): “Previous work [51] used a feed-forward convolutional neural network (CNN) to learn a forward simulation model of a video game.”
- World Models (2018, methodology): “(Matthew Guzdial, 2017) used a feed-forward convolutional neural network (CNN) to learn a forward simulation model of a video game.”