The Hate Speech Detection (HaSpeeDe 2) task is the second edition of a shared task on the detection of hateful content in Italian Twitter messages. HaSpeeDe 2 is composed of a Main task (hate speech detection) and two Pilot tasks,(stereotype and nominal utterance detection). Systems were challenged along two dimensions:(i) time, with test data coming from a different time period than the training data, and (ii) domain, with test data coming from the news domain (ie, news headlines). Overall, 14 teams participated in the Main task, the best systems achieved a macro F1-score of 0.8088 and 0.7744 on the indomain in the out-of-domain test sets, respectively; 6 teams submitted their results for Pilot task 1 (stereotype detection), the best systems achieved a macro F1-score of 0.7719 and 0.7203 on in-domain and outof-domain test sets. We did not receive any submission for Pilot task 2.
Haspeede 2@ evalita2020: Overview of the evalita 2020 hate speech detection task
Irene Russo
2020
Abstract
The Hate Speech Detection (HaSpeeDe 2) task is the second edition of a shared task on the detection of hateful content in Italian Twitter messages. HaSpeeDe 2 is composed of a Main task (hate speech detection) and two Pilot tasks,(stereotype and nominal utterance detection). Systems were challenged along two dimensions:(i) time, with test data coming from a different time period than the training data, and (ii) domain, with test data coming from the news domain (ie, news headlines). Overall, 14 teams participated in the Main task, the best systems achieved a macro F1-score of 0.8088 and 0.7744 on the indomain in the out-of-domain test sets, respectively; 6 teams submitted their results for Pilot task 1 (stereotype detection), the best systems achieved a macro F1-score of 0.7719 and 0.7203 on in-domain and outof-domain test sets. We did not receive any submission for Pilot task 2.| Campo DC | Valore | Lingua |
|---|---|---|
| dc.authority.orgunit | Istituto di linguistica computazionale "Antonio Zampolli" - ILC | en |
| dc.authority.people | Manuela Sanguinetti | en |
| dc.authority.people | Gloria Comandini | en |
| dc.authority.people | Elisa Di Nuovo | en |
| dc.authority.people | Simona Frenda | en |
| dc.authority.people | Marco Stranisci | en |
| dc.authority.people | Cristina Bosco | en |
| dc.authority.people | Tommaso Caselli | en |
| dc.authority.people | Viviana Patti | en |
| dc.authority.people | Irene Russo | en |
| dc.collection.id.s | 71c7200a-7c5f-4e83-8d57-d3d2ba88f40d | * |
| dc.collection.name | 04.01 Contributo in Atti di convegno | * |
| dc.contributor.appartenenza | Istituto di linguistica computazionale "Antonio Zampolli" - ILC | * |
| dc.contributor.appartenenza.mi | 918 | * |
| dc.date.accessioned | 2024/12/17 16:12:36 | - |
| dc.date.available | 2024/12/17 16:12:36 | - |
| dc.date.firstsubmission | 2024/10/09 14:29:13 | * |
| dc.date.issued | 2020 | - |
| dc.date.submission | 2024/10/09 14:29:13 | * |
| dc.description.abstracteng | The Hate Speech Detection (HaSpeeDe 2) task is the second edition of a shared task on the detection of hateful content in Italian Twitter messages. HaSpeeDe 2 is composed of a Main task (hate speech detection) and two Pilot tasks,(stereotype and nominal utterance detection). Systems were challenged along two dimensions:(i) time, with test data coming from a different time period than the training data, and (ii) domain, with test data coming from the news domain (ie, news headlines). Overall, 14 teams participated in the Main task, the best systems achieved a macro F1-score of 0.8088 and 0.7744 on the indomain in the out-of-domain test sets, respectively; 6 teams submitted their results for Pilot task 1 (stereotype detection), the best systems achieved a macro F1-score of 0.7719 and 0.7203 on in-domain and outof-domain test sets. We did not receive any submission for Pilot task 2. | - |
| dc.description.allpeople | Sanguinetti, Manuela; Comandini, Gloria; Di Nuovo, Elisa; Frenda, Simona; Stranisci, Marco; Bosco, Cristina; Caselli, Tommaso; Patti, Viviana; Russo, Irene | - |
| dc.description.allpeopleoriginal | Manuela Sanguinetti, Gloria Comandini, Elisa Di Nuovo, Simona Frenda, Marco Stranisci, Cristina Bosco, Tommaso Caselli, Viviana Patti, Irene Russo | en |
| dc.description.fulltext | open | en |
| dc.description.international | si | en |
| dc.description.numberofauthors | 9 | - |
| dc.identifier.source | manual | * |
| dc.identifier.uri | https://hdl.handle.net/20.500.14243/506041 | - |
| dc.language.iso | eng | en |
| dc.relation.ispartofbook | Evaluation Campaign of Natural Language Processing and Speech Tools for Italian | en |
| dc.subject.keywordseng | hate speech | - |
| dc.subject.singlekeyword | hate speech | * |
| dc.title | Haspeede 2@ evalita2020: Overview of the evalita 2020 hate speech detection task | en |
| dc.type.driver | info:eu-repo/semantics/conferenceObject | - |
| dc.type.full | 04 Contributo in convegno::04.01 Contributo in Atti di convegno | it |
| dc.type.miur | 273 | - |
| iris.mediafilter.data | 2025/04/08 04:47:09 | * |
| iris.orcid.lastModifiedDate | 2025/02/24 09:13:42 | * |
| iris.orcid.lastModifiedMillisecond | 1740384822646 | * |
| iris.sitodocente.maxattempts | 1 | - |
File in questo prodotto:
| File | Dimensione | Formato | |
|---|---|---|---|
|
paper162(2).pdf
accesso aperto
Tipologia:
Versione Editoriale (PDF)
Licenza:
Creative commons
Dimensione
278.53 kB
Formato
Adobe PDF
|
278.53 kB | Adobe PDF | Visualizza/Apri |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
