SemEval-2019 Task 5: Multilingual Detection of Hate Speech Against Immigrants and Women in Twitter

By Valerio Basile, Cristina Bosco, Elisabetta Fersini, Debora Nozza, Viviana Patti, Francisco Manuel Rangel Pardo, Paolo Rosso, Manuela Sanguinetti. 2019

1,079 citations recorded by the source corpus.

The paper describes the organization of the SemEval 2019 Task 5 about the detection of hate speech against immigrants and women in Spanish and English messages extracted from Twitter. The task is organized in two related classification subtasks: a main binary subtask for detecting the presence of hate speech, and a finer-grained one devoted to identifying further features in hateful contents such as the aggressive attitude and the target harassed, to distinguish if the incitement is against an individual rather than a group. HatEval has been one of the most popular tasks in SemEval-2019 with a total of 108 submitted runs for Subtask A and 70 runs for Subtask B, from a total of 74 different teams. Data provided for the task are described by showing how they have been collected and annotated. Moreover, the paper provides an analysis and discussion about the participant systems and the results they achieved in both subtasks.

Subfields: Artificial Intelligence, Communication, Law, Natural Language Processing, Safety, Robustness & Interpretability

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Yejin Choi
  2. Mohit Bansal
  3. Luke S. Zettlemoyer
  4. Noah A. Smith
  5. Percy Liang
  6. Kai-Wei Chang
  7. Jianfeng Gao
  8. Dirk Hovy

In Communication

  1. Valerio Basile
  2. Leon Derczynski
  3. Jelena Mitrović
  4. Michael Granitzer
  5. Viviana Patti
  6. Marcos Zampieri
  7. Verena Rieser
  8. Gavin Abercrombie

In Law

  1. Valerio Basile
  2. Marcos Zampieri
  3. Mai Elsherief
  4. Aida Mostafazadeh Davani
  5. Alexandra Sasha Luccioni
  6. Joseph D. Viviano
  7. Paula Fortuna
  8. Leon Derczynski

In Natural Language Processing

  1. Dirk Hovy
  2. Kai-Wei Chang
  3. Gavin Abercrombie
  4. Verena Rieser
  5. Valerio Basile
  6. Nanyun Peng
  7. Yejin Choi
  8. Diyi Yang

In Safety, Robustness & Interpretability

  1. Dirk Hovy
  2. Valerio Basile
  3. Emily Sheng
  4. Kai-Wei Chang
  5. Nanyun Peng
  6. Gavin Abercrombie
  7. Sunipa Dev
  8. Anne Lauscher

Citations in the corpus