Evaluation

By Kalervo Järvelin. 2008

2,757 citations recorded by the source corpus.

We conducted questionnaire surveys and experiments on odor quality evaluation in order to determine the criteria for selecting expressions that properly represent various kinds of odors and allow evaluation with high reproducibility. First, we chose 303 words and conducted questionnaire surveys on their suitability for the evaluation. Then, we performed experiments on odor quality evaluation with 80 odor samples. The result suggested that the difficulty in understanding odor quality representation, general frequency of use, variation in evaluation score, and correlation among evaluation expressions should be considered.

Subfields: Evaluation & Benchmarks

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Evaluation & Benchmarks

1. Ivan Vulic
2. Douwe Kiela
3. Anna Korhonen
4. David Bau
5. S. Flora
6. Frans Leeuw
7. T. Lund
8. V. Pachauri

Citations in the corpus

• Explaining Explanations: An Overview of Interpretability of Machine Learning (2018, background): “Extending this observation, a number of techniques have been shown for changing a network’s classification of any image to any target class by making imperceptible alterations to the pixels [3], [4], [5].”
• Storytelling as an Instructional Method: Definitions and Research Questions. (2009, background): “…to include the training of teams (Cooke, 2002; DuBois & Gillan, 2000; Oser et al., 1999; Salas et al., 2001; Van Berlo, 2005) and strives to develop highly elaborate measurement structures (Baker et al., 2004; Spiker et al., 2006; for a review of the levels of evaluation see Kirkpatrick, 1987).”
• Combining Qualitative and Quantitative Approaches: Some Arguments for Mixed Methods Research (2012, methodology): “Finally, evaluation research presupposes criteria (Weiss, 1998), and the evaluation criteria are here represented by methodological standards (e.”
• Unpacking Black Boxes: Mechanisms and Theory Building in Evaluation (2010, background): “Weiss (1972, 1995, 1997a), Wholey (1979, 1983), and Chen (1989, 1990), among others, have also helped establish the importance of investigating the theory underlying social programs.”
• A Systematic Review of Theory-Driven Evaluation Practice From 1990 to 2009 (2011, background): “Although its origins can be traced to Tyler in the 1930s (with his notion of formulating and testing program theory for evaluative purposes; Garangi, 2003, as cited in Donaldson, 2007), later reappearing in the 1960s and 1970s (e.g., Suchman, 1967; Weiss, 1972) and again in the 1980s (e.”
• A Systematic Review on the Practice of Evaluating Visualization (2013, background): “In particular, empiric evaluation and the consideration of human factors are actively being discussed [3, 9, 10, 11, 19, 36, 46, 53, 65, 68].”
• Global statistics on alcohol, tobacco and illicit drug use: 2017 status report (2018, methodology): “The GBD study 2015 (9) estimated that the same European regions also recorded the highest age-”
• Evaluating leadership coaching: A review and integrated framework (2010, background): “Reactions refer to the subjective evaluations individuals make about their training experiences (Kirkpatrick, 1996).”