Q* Approximation Schemes for Batch Reinforcement Learning: A Theoretical Comparison
By Tengyang Xie, Nan Jiang. 2020
83 citations recorded by the source corpus.
Subfields: Reinforcement Learning, Statistical Learning Theory
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Reinforcement Learning
- Nan Jiang
- Alekh Agarwal
- Ruosong Wang
- Andrea Zanette
- Yu-Xiang Wang
- Tengyang Xie
- Sham M. Kakade
- Yu Bai
In Statistical Learning Theory
- Ruosong Wang
- Nan Jiang
- Alekh Agarwal
- Sham M. Kakade
- Tengyang Xie
- Andrea Zanette
- Dean Phillips Foster
- Yu Bai
Citations in the corpus
- What are the Statistical Limits of Offline RL with Linear Function Approximation? (2020, methodology): “However, the algorithm in [Xie and Jiang, 2020a] requires a more stringent data distribution condition.”
- Exponential Lower Bounds for Batch Reinforcement Learning: Batch RL can be Exponentially Harder than Online RL (2020, background): “Xie & Jiang (2020b) show that under strong concentrability assumptions the BPI problem is solvable using only realizability and general (non-linear) function approximators and Liu et al. (2020) show how to find the best-in-class solution to the BPI problem while avoiding concetrability for general…”
- Bellman-consistent Pessimism for Offline Reinforcement Learning (2021, methodology): “We remark that both of these two measurements are weaker then traditional density-ratio definitions (e.g., [Munos and Szepesvári, 2008; Chen and Jiang, 2019; Xie and Jiang, 2020]) as we demonstrated before, as the dependence of C on π is relatively secondary.”
- Near-Optimal Offline Reinforcement Learning via Double Variance Reduction (2021, background): “They are both optimal up to logarithmic factors and our infinite-horizon result improves over the best known results, e.g., those derived for the fitted Q-iteration style algorithms [Xie and Jiang, 2020b].”
- Is Pessimism Provably Efficient for Offline RL? (2020, unknown): “…et al., 2015; Liu et al., 2018; Nachum et al., 2019a;b; Chen and Jiang, 2019; Tang et al., 2019; Kallus and Uehara, 2019; 2020; Fan et al., 2020; Xie and Jiang, 2020a;b; Jiang and Huang, 2020; Uehara et al., 2020; Duan et al., 2020; Yin et al., 2020; Qu and Wierman, 2020; Li et al., 2020; Liao…”