Provably Convergent Two-Timescale Off-Policy Actor-Critic with Function Approximation

By Shangtong Zhang, Bo Liu, Hengshuai Yao, Shimon Whiteson. 2019

60 citations recorded by the source corpus.

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

1. Shangtong Zhang
2. Bo Liu
3. Shimon Whiteson
4. Sergey Levine
5. J. Urgen Schmidhuber
6. Ofir Nachum
7. Bo Dai
8. Nan Jiang

Citations in the corpus

• GradientDICE: Rethinking Generalized Offline Estimation of Stationary Values (2020, methodology): “…2018) is off-policy evaluation (Precup et al., 2001; Maei, 2011; Jiang & Li, 2015; Sutton & Barto, 2018; Liu et al., 2018; Nachum et al., 2019; Zhang et al., 2020), where we want to estimate the performance of a target policy (average reward in the continuing setting or expected total…”