Rater types in writing performance assessments: A classification approach to rater variability

By T. Eckes. 2008

267 citations recorded by the source corpus.

Subfields: Education, Management Science and Operations Research

View Paper: https://www.semanticscholar.org/paper/b25f7796666b14ec83c45dcd337355fdfaef5045

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Education

1. George Leckie
2. J. Baird
3. T. Eckes
4. Alister H Cumming

In Management Science and Operations Research

1. George Leckie
2. J. Baird
3. Alister H Cumming
4. T. Eckes
5. S. Youn

Citations in the corpus

• Operational Rater Types in Writing Assessment: Linking Rater Cognition to Rater Behavior (2012, methodology): “In the present study, these rater types are called operational rater types (ORTs), for ease of distinction from those types identified in the previous rater cognition study (Eckes, 2008b), which are called cognitive rater types (CRTs).”
• Rater Effects on Essay Scoring: A Multilevel Analysis of Severity Drift, Central Tendency, and Rater Experience (2011, background): “Previous research (Eckes, 2008; Cumming, 1990; Wolfe et al., 1998) indicated that more experienced raters took into account factors that were not in the scoring rubric and it is possible that this also might have occurred here.”
• Assessing Integrated Writing Tasks for Academic Purposes: Promises and Perils (2013, background): “…more readily for language tests with fixed item-types, such as reading or listening abilities (e.g., Lee & Sawaki, 2009), rather than the more open-ended, complex, constructed responses that may be interpreted in variable ways as typically appear in the assessment of writing (e.g., Eckes, 2008).”