Effects of feedback delay on learning

103 citations recorded by the source corpus.

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

RUDDER: Return Decomposition for Delayed Rewards (2018, background): “Delayed rewards are often episodic or sparse and common in real-world problems [26, 21].”
How small system dynamics models can help the public policy process (2011, background): “Policy resistance and long delays between actions and their consequences make effective experiential learning extremely difficult (Sterman, 2000; Rahmandad, 2008; Rahmandad et al., 2009).”
Explaining and Interpreting LSTMs (2019, background): “However, they fail when the reward is delayed since they have to average over a large number of probabilistic future state-action paths that increases exponentially with the delay of the reward [58, 48].”
Time delays, competitive interdependence, and firm performance (2017, methodology): “…in psychology and management (e.g., Atkins, Wood, and Rutgers, 2002; Diehl and Sterman, 1995; Lam et al., 2011; Lurie and Swaminathan, 2009; Rahmandad, 2008; Rahmandad et al., 2009), which emphasizes actors’ tendency to move in the action space in directions that increase the perceived reward.”