DeepStack: Expert-level artificial intelligence in heads-up no-limit poker

By Matej Moravcík, Martin Schmid, Neil Burch, Viliam Lisý, Dustin Morrill, Nolan Bard, Trevor Davis, Kevin Waugh, Michael Bradley Johanson, Michael H. Bowling. 2017

1,018 citations recorded by the source corpus.

Computer code based on continual problem re-solving beats human professional poker players at a two-player variant of poker. Artificial intelligence masters poker Computers can beat humans at games as complex as chess or go. In these and similar games, both players have access to the same information, as displayed on the board. Although computers have the ultimate poker face, it has been tricky to teach them to be good at poker, where players cannot see their opponents' cards. Moravčík et al. built a code dubbed DeepStack that managed to beat professional poker players at a two-player poker variant called heads-up no-limit Texas hold'em. Instead of devising its strategy beforehand, DeepStack recalculated it at each step, taking into account the current state of the game. The principles behind DeepStack may enable advances in solving real-world problems that involve information asymmetry. Science, this issue p. 508 Artificial intelligence has seen several breakthroughs in recent years, with games often serving as milestones. A common feature of these games is that players have perfect information. Poker, the quintessential game of imperfect information, is a long-standing challenge problem in artificial intelligence. We introduce DeepStack, an algorithm for imperfect-information settings. It combines recursive reasoning to handle information asymmetry, decomposition to focus computation on the relevant decision, and a form of intuition that is automatically learned from self-play using deep learning. In a study involving 44,000 hands of poker, DeepStack defeated, with statistical significance, professional poker players in heads-up no-limit Texas hold’em. The approach is theoretically sound and is shown to produce strategies that are more difficult to exploit than prior approaches.

Subfields: Artificial Intelligence, Clinical Psychology, Economics and Econometrics, Reinforcement Learning, Game & Decision Theory

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Sergey Levine
  2. Yoshua Bengio
  3. Mohit Bansal
  4. Pieter Abbeel
  5. Quoc V. Le
  6. Ruslan Salakhutdinov
  7. Jianfeng Gao
  8. Percy Liang

In Clinical Psychology

  1. Neil Burch
  2. Jakob N. Foerster
  3. Hengyuan Hu
  4. Zhuoran Yang
  5. Adam Lerer
  6. Michael H. Bowling
  7. Vojtěch Kovařík
  8. Viliam Lisý

In Economics and Econometrics

  1. Yuxi Li
  2. Noam Brown
  3. Marc Lanctot
  4. Neil Burch
  5. Adam Lerer
  6. David Silver
  7. R´emi Munos
  8. Tuomas Sandholm

In Reinforcement Learning

  1. Sergey Levine
  2. Pieter Abbeel
  3. Yuxi Li
  4. Shimon Whiteson
  5. Chelsea Finn
  6. Timothy P. Lillicrap
  7. Jakob N. Foerster
  8. David Silver

In Game & Decision Theory

  1. Karl Tuyls
  2. Noam Brown
  3. Tuomas Sandholm
  4. Marc Lanctot
  5. Julien Pérolat
  6. Neil Burch
  7. Zhuoran Yang
  8. Jakob N. Foerster

Citations in the corpus