Could information theory provide an ecological theory of sensory processing?

By Joseph J. Atick. Network, 2011

454 citations recorded by the source corpus.

Subfields: Artificial Intelligence, Cognitive Neuroscience

View Paper: https://www.semanticscholar.org/paper/8c77c78b76355679562fa341fc6ea8eec3f1a2f3

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

In Cognitive Neuroscience

Citations in the corpus

Comparing deep neural networks against humans: object recognition when the signal gets weaker (2017, background): “image representations (Simoncelli, Freeman, Adelson, & Heeger, 1992; Simoncelli & Freeman, 1995) and the investigation of underlying coding principles such as redundancy reduction (Atick, 1992; Barlow, 1961; Olshausen & Field, 1996).”
Divisive normalization in olfactory population codes (2010, background): “These changes create an adaptive tradeoff that should maximize information transmission over a range of stimulus intensities (Atick, 1992).”
Reinforcement learning, efficient coding, and the statistics of natural tasks (2015, background): “However, efficient coding also has natural payoffs at the level of information processing [14].”
Saliency, attention, and visual search: an information theoretic approach. (2009, unknown): “A solution to this dilemma comes in the coding observed in the visual cortex wherein as suggested by Attneave and others (Atick, 1992; Attneave, 1954; Barlow, 1961) an efﬁcient representation of natural image statistics is established.”
Enhanced Phone Posteriors for Improving Speech Recognition Systems (2010, background): “If the targeted events are independent, the output of the trained Tandem MLP could represent an estimate of the efficient low-entropy statistically-independent code, hypothesized in perceptual processing [21, 22].”
Event-Based Visual Flow (2014, background): “I. INTRODUCTION RECENT work in this paper of neural activity has shownthat each spike arrival time is reliable [1]–[4].”
Predictive Feedback Can Account for Biphasic Responses in the Lateral Geniculate Nucleus (2009, methodology): “be largely determined by the statistics of their natural input [7,11,14,26].”
Empowerment - an Introduction (2013, background): “Later research (Atick 1992) based on this identifies the importance of information bottlenecks for the compression of redundancies, which are later formalized in information theoretic terms (Tishby et al. 1999).”