Tie-Breaking Bias: Effect of an Uncontrolled Parameter on Information Retrieval Evaluation

By Guillaume Cabanac, Gilles Hubert, Mohand Boughanem, Claude Chrisment. 2010

21 citations recorded by the source corpus.

Subfields: Artificial Intelligence, Information Systems

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

1. Jimmy J. Lin
2. Peilin Yang
3. Zeynep Akkalyoncu Yilmaz
4. Rodrigo Nogueira
5. Wei Yang
6. Sebastian Hofstätter
7. Allan Hanbury
8. Andrew Yates

In Information Systems

1. Jimmy J. Lin
2. Peilin Yang
3. Zeynep Akkalyoncu Yilmaz
4. Rodrigo Nogueira
5. Wei Yang
6. Sebastian Hofstätter
7. Sean MacAvaney
8. Allan Hanbury

Citations in the corpus

• The Impact of Score Ties on Repeatability in Document Ranking (2018, methodology): “[3] studied the behavior of the widely-used trec_eval tool (also used in our study) and concluded that tie-breaking strategy can have substantive impact on conclusions about the relative effectiveness of different runs in terms of average precision.”