Xi-Ren Cao
Reinforcement Learning · 2005–2007
A researcher in the Science corpus: 3 papers; trusts 9 researchers and is trusted by 38 researchers here, as inferred from the citation graph.
Subfields
- Reinforcement Learning — 11 citations into it; #597 of 2,242 by trust here, #1,190 by citations
- Artificial Intelligence — 6 citations into it; #16,259 of 35,345 by trust here, #33,294 by citations
- Mathematical Optimization — 5 citations into it; #119 of 422 by trust here, #165 by citations
Whom Xi-Ren Cao trusts overall
Their strongest outbound trust, strongest first, inferred from their citations.
- Martin L. Puterman
- Dimitri P. Bertsekas
- Peter W. Glynn
- Sean P. Meyn
- Peter Marbach
- John N. Tsitsiklis
- Richard L. Tweedie
- Jonathan Baxter
- Richard S. Sutton
- Reuven Y. Rubinstein
Who trusts Xi-Ren Cao overall
- Dimitri P. Bertsekas
- Bruno Scherrer
- Csaba Szepesvari
- Nan Jiang
- Rasool Fakoor
- Yinyu Ye
- Ofir Nachum
- Shie Mannor
- Sridhar Mahadevan
- Huizhen Yu
Papers from Xi-Ren Cao's perspective
Ordered by how strongly the researchers Xi-Ren Cao trusts endorse each paper. Same corpus, a different order for every researcher.
- Markov Chains and Stochastic Stability
- Markov Decision Processes: Discrete Stochastic Dynamic Programming
- Likelilood ratio gradient estimation: an overview
- Dynamic Programming and Markov Processes
- Markov Decision Processes: Discrete Stochastic Dynamic Programming
- Simulation and the Monte Carlo method
- Reinforcement learning
- Simulation-based optimization of Markov reward processes
- On the Convergence of Stochastic Iterative Dynamic Programming Algorithms
- Stochastic Approximation and Recursive Algorithms and Applications
Their papers
- A basic formula for online policy gradient algorithms (2005) — 40 citations
- Stochastic learning and optimization - A sensitivity-based approach (2007) — 353 citations
- Exact finite approximations of average-cost countable Markov decision processes (2007) — 796 citations