The labor economics of paid crowdsourcing

By John Joseph Horton, Lydia B. Chilton. 2010

677 citations recorded by the source corpus.

We present a model of workers supplying labor to paid crowdsourcing projects. We also introduce a novel method for estimating a worker's reservation wage - the key parameter in our labor supply model. We tested our model by presenting experimental subjects with real-effort work scenarios that varied in the offered payment and difficulty. As predicted, subjects worked less when the pay was lower. However, they did not work less when the task was more time-consuming. Interestingly, at least some subjects appear to be "target earners," contrary to the assumptions of the rational model. The strongest evidence for target earning is an observed preference for earning total amounts evenly divisible by 5, presumably because these amounts make good targets. Despite its predictive failures, we calibrate our model with data pooled from both experiments. We find that the reservation wages of our sample are approximately log normally distributed, with a median wage of $1.38/hour. We discuss how to use our calibrated model in applications.

Subfields: Computer Science Applications, Management Science and Operations Research, Safety Research, Natural Language Processing, Economics & Operations Research

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Science Applications

  1. Gabriele Paolacci
  2. J. Goodman
  3. Jesse J. Chandler
  4. Adam Marcus
  5. Aditya G. Parameswaran
  6. D. Shapiro
  7. Michael S. Bernstein
  8. Dana Chandler

In Management Science and Operations Research

  1. Adam Marcus
  2. Adish Kumar Singla
  3. Aditya G. Parameswaran
  4. Andreas Krause
  5. Dana Chandler
  6. Jaime Teevan
  7. Matthew Richardson
  8. Irwin King

In Safety Research

  1. Gabriele Paolacci
  2. J. Goodman
  3. Jesse J. Chandler
  4. Nicolas Sommet
  5. Martin J. Burnham
  6. Yen K. Le
  7. Dana Chandler
  8. Andreas Krause

In Natural Language Processing

  1. Yuxiang (Chris) Zhao
  2. Qinghua Zhu
  3. Matthew Richardson
  4. Dana Chandler
  5. Jaime Teevan
  6. Irwin King
  7. Andreas Krause
  8. Daniel J. Veit

In Economics & Operations Research

  1. Dana Chandler
  2. Andreas Krause
  3. Daniel J. Veit
  4. J. Goodman
  5. A. Elliot
  6. Adish Kumar Singla
  7. Kevin Crowston
  8. Jennifer Widom

Citations in the corpus