Decision Tree Design for Classification in Crowdsourcing Systems

By Baocheng Geng, Qunwei Li, Pramod K. Varshney. 2018

10 citations recorded by the source corpus.

In this paper, we present a novel sequential paradigm for classification in crowdsourcing systems. Considering that workers are unreliable and they perform the tests with errors, we study the construction of decision trees so as to minimize the probability of mis-classification. By exploiting the connection between probability of mis-classification and entropy at each level of the decision tree, we propose two algorithms for decision tree design. Furthermore, the worker assignment problem is studied when workers can be assigned to different tests of the decision tree to provide a trade-off between classification cost and resulting error performance. Numerical results are presented for illustration.

Subfields: Artificial Intelligence, Computer Science Applications, Evaluation & Benchmarks

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Carrie J. Cai
  2. Michael Terry
  3. Tongshuang Sherry Wu
  4. Ellen Jiang
  5. Chitta Baral
  6. Swaroop Mishra
  7. Mihir Parmar
  8. Percy Liang

In Computer Science Applications

  1. Carrie J. Cai

In Evaluation & Benchmarks

  1. Tongshuang Sherry Wu

Citations in the corpus