A Counterexample to Temporal Differences Learning

By Dimitri P. Bertsekas. 1995

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

1. Benjamin Van Roy
2. John N. Tsitsiklis
3. Richard S. Sutton
4. Huizhen Yu
5. Sergey Levine
6. Dimitri P. Bertsekas
7. Csaba Szepesvari
8. Ian Osband

Citations in the corpus

• Learning to Act by Predicting the Future (2016, neutral): “The convergence of such methods was analyzed early on and they were seen as theoretically advantageous, particularly when function ap-proximators are used (Bertsekas, 1995; Sutton, 1995; Singh & Sutton, 1996).”
• An analysis of temporal-difference learning with function approximation (1997, background): “Indeed, such predictions constitute t he cost-to-go function that i s c e n tral to dynamic programming a n d o ptimal control (Bertsekas, 1995).”