The FCE Speaking test: using rater reports to help interpret test scores

By M. Orr. 2002

103 citations recorded by the source corpus.

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Interactional Competence in a Paired Speaking Test: Features Salient to Raters (2011, background): “Studies that have attempted to go “beyond scores” through the use of verbal reports have been carried out by Orr (2002), Ducasse and Brown (2009), and May (2009).”
Interactional Competence across Proficiency Levels: How do Learners Manage Interaction in Paired Speaking Tests? (2014, result): “In an earlier study Orr (2002) came to a similar conclusion, namely that the construct of IC in assessment scales is often narrower than what the raters themselves use in the assessment process.”
What counts as “responding”? Contingency on previous speaker contribution as a feature of interactional competence (2018, background): “Features of IC found to be salient to raters include conversational management, interactive listening, using body language, and developing one’s own and others’ ideas, and helping co-participants (Ducasse & Brown, 2009; May, 2011; Orr, 2002).”
The influence of training and experience on rater performance in scoring spoken language (2016, background): “Raters have also been observed to give the same score for opposite reasons (Orr, 2002).”