Universal Estimation of Information Measures for Analog Sources

By Qing Wang, Sanjeev R. Kulkarni, Sergio Verdú. 2009

57 citations recorded by the source corpus.

Subfields: Artificial Intelligence, Signal Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

In Signal Processing

Citations in the corpus

Nonparametric Divergence Estimation with Applications to Machine Learning on Distributions (2011, methodology): “Wang et al. (2009b) 1 and Pérez-Cruz (2008) 2 provided an estimator for kl -divergence, and Póczos and Schneider (2011) developed nonparametric methods for the Rényi and Tsallis divergence estimation.”
A Non-parametric Bayesian Network Prior of Human Pose (2013, unknown): “Here, we use a continuous variant of the Chow-Liu tree, where reliable estimation of mutual information is a hard problem [25].”
Minimax Estimation of Functionals of Discrete Distributions (2014, unknown): “[65] Y. Polyanskiy, H. V. Poor, and S. Verdú, “Channel coding rate in the finite blocklength regime,” Information Theory, IEEE Transactions on, vol. 56, no. 5, pp. 2307–2359, 2010.”
Rényi divergence measures for commonly used univariate continuous distributions (2013, unknown): “Alternatively, the partitioning, k(n) nearest-neighbor, and minimum spanning tree based methods reviewed in [33] and the references therein should also provide consistent estimates.”
Estimation of Renyi Entropy and Mutual Information Based on Generalized Nearest-Neighbor Graphs (2010, background): “For further applications, see Leonenko et al. (2008); Wang et al. (2009a).”
On the Estimation of alpha-Divergences (2011, background): “Further information and useful reviews of several different divergences can be found, e.g., in Villmann and Haase (2010), Cichocki et al. (2009), and Wang et al. (2009b).”