A Glimpse Far into the Future: Understanding Long-term Crowd Worker Accuracy

By Kenji Hata, Ranjay Krishna, Li Fei-Fei, Michael S. Bernstein. 2016

10 citations recorded by the source corpus.

Subfields: Evaluation & Benchmarks, Human-Computer Interaction

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Evaluation & Benchmarks

1. Vittorio Ferrari
2. Jasper R. R. Uijlings
3. Dim P. Papadopoulos
4. Tianfu Wu
5. Michael Gygli
6. Yuhui Yuan
7. Björn Ommer
8. Robin Rombach

In Human-Computer Interaction

1. Vittorio Ferrari
2. Jasper R. R. Uijlings
3. Dim P. Papadopoulos
4. Michael Gygli

Citations in the corpus

• Y Qualification Main task Y Return N N Y User qualified ? N Feedback Pass ? Pass ? Annotator training Annotating images (2017, background): “Annotators that have reached the desired level of quality can be expected to keep it throughout the annotation [30].”