Information Theory and Coding

By Steve Hranilovic. 2005

462 citations recorded by the source corpus.

Subfields: Computational Theory and Mathematics

View Paper: https://www.semanticscholar.org/paper/2038e45ef000eeab67ea987d9f148ab13aa0e4b4

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computational Theory and Mathematics

Citations in the corpus

Quantitative methods for ecological network analysi (2004, background): “In terms of the fluxesTijk , it can be calculated (Abramson, 1963; Pahl-Wostl, 1995) as: AMI 3 = ∑ i,j,k ( Tijk T... ) log ( T 2ijkT... Ti..T.j.”
Longitudinal trends in networks of university-industry-government relations in South Korea: The role of programmatic incentives (2009, background): “Hi + Hj – Tij (3) Tij = Hi + Hj – Hij (4) Tij is zero if the two distributions are completely independent (i.e., the co-variation is zero), but otherwise necessarily positive (Theil, 1972, pp. 59f.). Abramson (1963, p. 129) derived that the mutual information in three dimensions—let us use “u” for u”
Text Compression as a Test for Artificial Intelligence (1999, background): “By the Kraft inequalit y (Abramson 1963), this code length is the smallest we can use so that every string x is assigned a unique code.”
A maximum entropy approach to adaptive statistical language modelling (1996, methodology): “Language is considered an information source L ([Abramson 63]), which emits a sequence of symbols w i from a ﬁnite alphabet (the vocabulary).”
Information Theory in Ecology (2001, background): “…data to quantify networks over time and space can pose significant logistical problems, there is no conceptual barrier to extending the indices into the temporal and spatial domains, for all the information indices treated thus far possess counterparts in 3 or more dimensions (Abramson 1963.)”
Measuring the knowledge base of an economy in terms of triple-helix relations among 'technology, organization, and territory' (2004, background): “Unlike the mutual information in two dimensions (Shannon, 1948; Theil, 1972), information among three dimensions can become negative (McGill, 1954; Abramson, 1963).”
A Comparison of MCC and CEN Error Measures in Multi-Class Prediction (2010, methodology): “…have been deﬁned in the classiﬁcation framework based on the entropy function, from simpler ones such as the confusion matrix entropy (van Son, 1994), to more complex expressions as the transmitter information (Abramson, 1963) or the relative classiﬁer information (RCI) (Sindhwani et al., 2001).”
Introduction to Data Compression (2005, background): “However, he never published it, and we only know about it through a mention in a 1963 book on information theory by Abramson [39].”
Measuring the knowledge base of regional innovation systems in Germany in terms of a Triple Helix dynamics, Research Policy (forthcoming). (2006, methodology): “In principle, uncertainties like the ‘configurational information’ contained in the overlay can be measured using the mathematical theory of communication (Shannon, 1948; McGill, 1954; Abramson, 1963; Theil, 1972).”