Information Theory
Coding, entropy, and information-theoretic analysis.
A topic in the Science corpus, drawn from 152 papers.
Trusted voices in Information Theory
Ordered by the trust Information Theory's own network concentrates on each researcher, most first.
- Hirotogu Akaike — trusted by 647 researchers here
- Hirotugu Akaike — trusted by 647 researchers here
- Huaiyu Zhu — trusted by 425 researchers here
- Claude E. Shannon — trusted by 501 researchers here
- Jorma Rissanen — trusted by 319 researchers here
- Johannes Blömer — trusted by 341 researchers here
- Gitta Kutyniok — trusted by 346 researchers here
- Jianhua Lin — trusted by 221 researchers here
- Dekang Lin — trusted by 178 researchers here
- Andrew R. Barron — trusted by 145 researchers here
- Torben P. Pedersen — trusted by 96 researchers here
- Fernando C Pereira — trusted by 125 researchers here
Most-cited papers in Information Theory
Ordered by the recorded citation count from the source corpus; a citation is not an endorsement.
- Compressed Sensing (2012) — 17,863 citations
- The information bottleneck method (2000) — 4,490 citations
- Estimating mutual information. (2003) — 4,216 citations
- Elements of Information Theory (Wiley Series in Telecommunications and Signal Processing) (2006) — 1,994 citations
- Information Theory: Multi-terminal systems (2011) — 1,903 citations
- Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting (2009) — 1,787 citations
- Rényi Divergence and Kullback-Leibler Divergence (2012) — 1,563 citations
- Communication Complexity (2016) — 1,331 citations
- Automorphisms of Order 2p in Binary Self-Dual Extremal Codes of Length a Multiple of 24 (2013) — 1,317 citations
- Conditional Likelihood Maximisation: A Unifying Framework for Information Theoretic Feature Selection (2012) — 1,252 citations
- Normalized (pointwise) mutual information in collocation extraction (2009) — 1,094 citations
- The Composition Theorem for Differential Privacy (2013) — 825 citations
- Information theoretic MPC for model-based reinforcement learning (2017) — 671 citations
- Learning to Explain: An Information-Theoretic Perspective on Model Interpretation (2018) — 666 citations
- On Divergences and Informations in Statistics and Information Theory (2006) — 664 citations
- Theoretical Comparison between the Gini Index and Information Gain Criteria (2004) — 638 citations
- Sequential Decisions based on Algorithmic Probability (2008) — 628 citations
- CLUB: A Contrastive Log-ratio Upper Bound of Mutual Information (2020) — 541 citations
- The IM algorithm: a variational approach to Information Maximization (2003) — 535 citations
- Toeplitz And Circulant Matrices: A Review (Foundations and Trends(R) in Communications and Information Theory) (2006) — 461 citations
- The Capacity of Private Information Retrieval (2016) — 454 citations
- $f$ -Divergence Inequalities (2015) — 428 citations
- Information-Theoretic Considerations in Batch Reinforcement Learning (2019) — 421 citations
- A tutorial introduction to the minimum description length principle (2004) — 387 citations
- The Capacity of Private Information Retrieval From Coded Databases (2016) — 362 citations
- Causal Inference Using the Algorithmic Markov Condition (2008) — 345 citations
- Formal Limitations on the Measurement of Mutual Information (2018) — 337 citations
- A unified view of entropy-regularized Markov decision processes (2017) — 318 citations
- Building a RAPPOR with the Unknown: Privacy-Preserving Learning of Associations and Data Dictionaries (2015) — 318 citations
- Information-geometric approach to inferring causal directions (2012) — 317 citations
- Text Compression (2009) — 312 citations
- Subjective Logic (2016) — 302 citations
- Information-Theoretic Probing for Linguistic Structure (2020) — 280 citations
- Information, Divergence and Risk for Binary Experiments (2009) — 250 citations
- Understanding the Limitations of Variational Mutual Information Estimators (2019) — 248 citations
- The Communication Complexity of Correlation (2007) — 223 citations
- Learning Representations for Neural Network-Based Classification Using the Information Bottleneck Principle (2018) — 220 citations
- A Theory of Usable Information Under Computational Constraints (2020) — 217 citations
- Information and Computation (2013) — 216 citations
- Information-theoretic upper and lower bounds for statistical estimation (2006) — 212 citations
- The geometry of proper scoring rules (2007) — 196 citations
- Unsupervised Multi-Target Domain Adaptation: An Information Theoretic Approach (2018) — 193 citations
- Communication lower bounds for statistical estimation problems via a distributed data processing inequality (2015) — 193 citations
- Coordinate descent optimization for l 1 minimization with application to compressed sensing; a greedy algorithm (2009) — 190 citations
- Adaptive weighing of context models for lossless data compression (2005) — 169 citations
- An Information Theoretic Framework for Multi-view Learning (2008) — 161 citations
- Asymmetric numeral systems (2009) — 157 citations
- Multiple Source Adaptation and the Rényi Divergence (2009) — 156 citations
- Black-box $\alpha$-divergence Minimization (2015) — 152 citations
- Private Information Retrieval with Sublinear Online Time (2020) — 149 citations
Most active researchers
By papers in this topic: a volume measure, not trust.
- Marcus Hutter — 3 papers
- David Barber — 3 papers
- Dominik Janzing — 3 papers
- Bernhard Schölkopf — 3 papers
- Himanshu Tyagi — 2 papers
- Claude E. Shannon — 2 papers
- Sham M. Kakade — 2 papers
- Robert M. Gray — 2 papers
- Ayfer Özgür — 2 papers
- Gilles Barthe — 2 papers
- Thomas M. Cover — 2 papers
- Bastian Steudel — 2 papers