A mathematical theory of communication

By Claude E. Shannon. 1948

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Citations in the corpus

Deep learning in neural networks: An overview (2014, background): “Many UL methods are designed to maximize entropy-related, information-theoretic (Boltzmann, 1909; Kullback & Leibler, 1951; Shannon, 1948) objectives (e.g., Amari, Cichocki, & Yang, 1996; Barlowet al., 1989;Dayan&Zemel, 1995;Deco&Parra, 1997; Field, 1994; Hinton, Dayan, Frey, & Neal, 1995; Linsker,…”
Forecasting Across Time Series Databases using Long Short-Term Memory Networks on Groups of Similar Series (2017, background): “esis/theory H, given the data D can be formally written as follows: Pr(H&D) = Pr(DjH)Pr(H) Here, Pr(H&D) refers to the joint probability of H and D. According to Shannon’s information theory (Shannon, 1948), the optimal length of the message, which describes an event Eis given by log(Pr(E)).”
Where is the Information in a Deep Neural Network? (2019, background): “In this section, we relate different choices of pre- and post-distributions to well-known definitions, in particular (Shannon, 1948) and (Fisher, 1925).”
A Comprehensive Study of Class Incremental Learning Algorithms for Visual Tasks (2020, methodology): “We also tried exemplar selection techniques inspired from active learning approaches such as: entropy [52], min margin [51], core-set [50], k-means [62].”
Recurrent Relational Networks (2017, background): “at rely on loopy belief propagation. One prominent example of loopy belief propagation is in error correcting codes which everything from mobile phones to satellites rely on for robust communication (Shannon, 1948; MacKay & Neal, 1996). 5 RELATED WORK Relational networks (Santoro et al., 2017) a”
Biodiversity of traits and species both show weak responses to hydromorphological alteration in lowland river macroinvertebrates (2014, unknown): “C (Shannon, 1948; Simpson, 1949; Pielou, 1966)”
Investment prioritizing in high tech industries based on SWARA-COPRAS approach (2014, background): “Some famous weight assessment approaches in the literature including analytic hierarchy process (AHP) (Saaty 1980), analytic network process (ANP) (Saaty, Vargas 2001), Entropy (Shannon 1948; Susinskas et al.”