Information Theory

Coding, entropy, and information-theoretic analysis.

A topic in the Science corpus, drawn from 152 papers.

Trusted voices in Information Theory

Ordered by the trust Information Theory's own network concentrates on each researcher, most first.

  1. Hirotogu Akaike — trusted by 647 researchers here
  2. Hirotugu Akaike — trusted by 647 researchers here
  3. Huaiyu Zhu — trusted by 425 researchers here
  4. Claude E. Shannon — trusted by 501 researchers here
  5. Jorma Rissanen — trusted by 319 researchers here
  6. Johannes Blömer — trusted by 341 researchers here
  7. Gitta Kutyniok — trusted by 346 researchers here
  8. Jianhua Lin — trusted by 221 researchers here
  9. Dekang Lin — trusted by 178 researchers here
  10. Andrew R. Barron — trusted by 145 researchers here
  11. Torben P. Pedersen — trusted by 96 researchers here
  12. Fernando C Pereira — trusted by 125 researchers here

Most-cited papers in Information Theory

Ordered by the recorded citation count from the source corpus; a citation is not an endorsement.

  1. Compressed Sensing (2012) — 17,863 citations
  2. The information bottleneck method (2000) — 4,490 citations
  3. Estimating mutual information. (2003) — 4,216 citations
  4. Elements of Information Theory (Wiley Series in Telecommunications and Signal Processing) (2006) — 1,994 citations
  5. Information Theory: Multi-terminal systems (2011) — 1,903 citations
  6. Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting (2009) — 1,787 citations
  7. Rényi Divergence and Kullback-Leibler Divergence (2012) — 1,563 citations
  8. Communication Complexity (2016) — 1,331 citations
  9. Automorphisms of Order 2p in Binary Self-Dual Extremal Codes of Length a Multiple of 24 (2013) — 1,317 citations
  10. Conditional Likelihood Maximisation: A Unifying Framework for Information Theoretic Feature Selection (2012) — 1,252 citations
  11. Normalized (pointwise) mutual information in collocation extraction (2009) — 1,094 citations
  12. The Composition Theorem for Differential Privacy (2013) — 825 citations
  13. Information theoretic MPC for model-based reinforcement learning (2017) — 671 citations
  14. Learning to Explain: An Information-Theoretic Perspective on Model Interpretation (2018) — 666 citations
  15. On Divergences and Informations in Statistics and Information Theory (2006) — 664 citations
  16. Theoretical Comparison between the Gini Index and Information Gain Criteria (2004) — 638 citations
  17. Sequential Decisions based on Algorithmic Probability (2008) — 628 citations
  18. CLUB: A Contrastive Log-ratio Upper Bound of Mutual Information (2020) — 541 citations
  19. The IM algorithm: a variational approach to Information Maximization (2003) — 535 citations
  20. Toeplitz And Circulant Matrices: A Review (Foundations and Trends(R) in Communications and Information Theory) (2006) — 461 citations
  21. The Capacity of Private Information Retrieval (2016) — 454 citations
  22. $f$ -Divergence Inequalities (2015) — 428 citations
  23. Information-Theoretic Considerations in Batch Reinforcement Learning (2019) — 421 citations
  24. A tutorial introduction to the minimum description length principle (2004) — 387 citations
  25. The Capacity of Private Information Retrieval From Coded Databases (2016) — 362 citations
  26. Causal Inference Using the Algorithmic Markov Condition (2008) — 345 citations
  27. Formal Limitations on the Measurement of Mutual Information (2018) — 337 citations
  28. A unified view of entropy-regularized Markov decision processes (2017) — 318 citations
  29. Building a RAPPOR with the Unknown: Privacy-Preserving Learning of Associations and Data Dictionaries (2015) — 318 citations
  30. Information-geometric approach to inferring causal directions (2012) — 317 citations
  31. Text Compression (2009) — 312 citations
  32. Subjective Logic (2016) — 302 citations
  33. Information-Theoretic Probing for Linguistic Structure (2020) — 280 citations
  34. Information, Divergence and Risk for Binary Experiments (2009) — 250 citations
  35. Understanding the Limitations of Variational Mutual Information Estimators (2019) — 248 citations
  36. The Communication Complexity of Correlation (2007) — 223 citations
  37. Learning Representations for Neural Network-Based Classification Using the Information Bottleneck Principle (2018) — 220 citations
  38. A Theory of Usable Information Under Computational Constraints (2020) — 217 citations
  39. Information and Computation (2013) — 216 citations
  40. Information-theoretic upper and lower bounds for statistical estimation (2006) — 212 citations
  41. The geometry of proper scoring rules (2007) — 196 citations
  42. Unsupervised Multi-Target Domain Adaptation: An Information Theoretic Approach (2018) — 193 citations
  43. Communication lower bounds for statistical estimation problems via a distributed data processing inequality (2015) — 193 citations
  44. Coordinate descent optimization for l 1 minimization with application to compressed sensing; a greedy algorithm (2009) — 190 citations
  45. Adaptive weighing of context models for lossless data compression (2005) — 169 citations
  46. An Information Theoretic Framework for Multi-view Learning (2008) — 161 citations
  47. Asymmetric numeral systems (2009) — 157 citations
  48. Multiple Source Adaptation and the Rényi Divergence (2009) — 156 citations
  49. Black-box $\alpha$-divergence Minimization (2015) — 152 citations
  50. Private Information Retrieval with Sublinear Online Time (2020) — 149 citations

Most active researchers

By papers in this topic: a volume measure, not trust.