Low-Cost Preference Judgment via Ties

9 citations recorded by the source corpus.

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Human Preferences as Dueling Bandits (2022, neutral): “We also consider candidate algorithms from the literature related to human preferences for information retrieval evaluation [7, 9, 17, 27, 32, 35].”
Preference-based Evaluation Metrics for Web Image Search (2020, background): “[20] and Hui and Berberich [7] investigate weak preference judgments (i.”
Evaluation Measures Based on Preference Graphs (2021, background): “Preferences may provide a more solid foundation for offline evaluation [3, 7, 11, 17, 18, 22, 26, 29, 30].”
Assessing Top- Preferences (2020, background): “ce relative to the previously seen document. „eir results call into question the standard practice of converting relevance grades into gain values for the purpose of computing NDCG. Hui and Berberich [18, 19] explore the transitivity of crowdsourced preference judgments and propose an algorithm base”