Reliability for Content Analysis

By Kimberly A. Neuendorf. 2010

711 citations recorded by the source corpus.

Subfields: Agronomy and Crop Science, Epidemiology, General Health Professions

View Paper: https://www.semanticscholar.org/paper/617f0bcc8caf2f4f8496a93d5ca5847b7fe05f01

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Agronomy and Crop Science

In Epidemiology

In General Health Professions

Citations in the corpus

Controversial Rap Themes, Gender Portrayals and Skin Tone Distortion: A Content Analysis of Rap Music Videos (2009, methodology): “Intraclass correlation coefficients as opposed to a Pearson moment co-efficient or Cronbach’s alpha were computed for the continuous theme variables collected at the video level (Bartko, 1966; Krippendorf, 2004; McGraw & Wong, 1996).”
Appraise: an Open-Source Toolkit for Manual Evaluation of MT Output (2012, methodology): “- Krippendorff’s α as described by [9]; - Fleiss’ κ as published in [8]; - Bennett, Alpert, and Goldsteins S as defined in [1]; - Scott’s π as introduced in [12].”
A 22 year review of strategic alliance research in the leading management journals (2016, methodology): “Content analysis is a widely used method in social science research (Krippendorff, 2004).”
Developing a unified definition of digital transformation (2021, methodology): “Content Analysis is often used as a companion research instrument in multi-method studies employing diverse methods to enhance the validity of results by minimizing biases (Krippendorff, 2004), and the best content-analytic studies use both qualitative and quantitative operations (Weber, 1990).”
Motivations of manufacturing reshoring: an interpretative framework (2016, neutral): “We followed standard content-analysis procedures (Krippendorff, 2004) and classified the articles, editorials, and letters as either a primary article (reshoring or equivalent keywords appeared in the headline or first paragraph and at least once in the remaining text) or a secondary article…”
CROWDSOURCING A WORD–EMOTION ASSOCIATION LEXICON (2013, background): “Scott’s Π (Scott, 1955) calculates chance agreement by determining the distribution each of the categories (regardless of who the annotator is).”
Ex Machina: Personal Attacks Seen at Scale (2016, background): “In the case of a model trained on OH labels, the attack score represents the probability that the majority of annotators would consider the comment an attack.”
Demystifying Content Analysis (2020, methodology): “While calculating percentage agreement has sometimes been used to establish inter-rater reliability, most publication editors require more rigorous statistical analysis (eg, Krippendorf’s alpha, or Cohen’s kappa).(19) Detailed descriptions of these statistics fall outside the scope of this introduct”
Corporate Social Responsibility in China: A Corporate Governance Approach (2014, neutral): “It is recognized that measuring CSR performance is a difficult task (Hackston and Milne 1996; Krippendorff 2004) because of both methods and disclosure incentives.”
Resources and Governance in "Base of the Pyramid"-Partnerships: Assessing Collaborations between Businesses and Non-Business Actors (2014, methodology): “Referring to main contributors to the method of content analysis (Mayring, 2010; Kassarjian, 1977; Krippendorff, 2004), Seuring and Gold (2012) distill a four-step approach for conducting content analysis that we followed in the frame of this case study: material collection through interviews, descr”
A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda (2020, result): “At this stage, we compared the results and discussed discrepancies in the way we coded the articles until we reached consensus, instead of calculating the discrepancies quantitatively as suggested by Krippendorff (2004) or Holsti (1969).”
What is frugal innovation? Three defining criteria (2016, methodology): “Since it is customary to require α ≥ .800, our results are reliable (Gwet 2014; Krippendorff 2004).”
I'm Going to Instagram It! An Analysis of Athlete Self-Presentation on Instagram (2015, methodology): “Content analysis is an unobtrusive and nonreactive method commonly used by social researchers and applied to all types of media content (Krippendorff, 2004).”
The Effects of Message Framing and Visual Image on Persuasion (2013, background): “66 (Krippendorff, 2004), close inspection led us to believe that they resulted from uneven distribution of data rather than a problem with the coding scheme itself.”
Content Analysis—A Methodological Primer for Gender Research (2011, background): “Neuendorf (2009) cited Sex Roles as one of a half-dozen journals with better-thanaverage reliability assessment reportage in articles on health-related content analyses.”
Free Association in Psychology and the Grid Elaboration Method (2014, background): “However, Krippendorff (2004) notes that the meaning of talk or text only arises in the process of somebody conceptually engaging with them; some level of interpretation is therefore necessary to discern their meanings.”