Shared task evaluation campaigns represent a well established form of competitive evaluation, an important opportunity to propose and tackle new challenges for a specific research area and a way to foster the development of benchmarks, tools and resources. The advantages of this approach are evident in any experimental field, including the area of Natural Language Processing. An outlook on state-of-the-art language technologies for Italian can be obtained by reflecting on the results of the recently held workshop "Evaluation of NLP and Speech Tools for Italian", EVALITA 2014. The motivations underlying individual shared tasks, the level of knowledge and development achieved within each of them, the impact on applications, society and economy at large as well as directions for future research will be discussed from this perspective.

State of the Art Language Technologies for Italian: The EVALITA 2014 Perspective

Dell'Orletta Felice;Montemagni Simonetta;
2015

Abstract

Shared task evaluation campaigns represent a well established form of competitive evaluation, an important opportunity to propose and tackle new challenges for a specific research area and a way to foster the development of benchmarks, tools and resources. The advantages of this approach are evident in any experimental field, including the area of Natural Language Processing. An outlook on state-of-the-art language technologies for Italian can be obtained by reflecting on the results of the recently held workshop "Evaluation of NLP and Speech Tools for Italian", EVALITA 2014. The motivations underlying individual shared tasks, the level of knowledge and development achieved within each of them, the impact on applications, society and economy at large as well as directions for future research will be discussed from this perspective.
Campo DC Valore Lingua
dc.authority.ancejournal INTELLIGENZA ARTIFICIALE -
dc.authority.orgunit Istituto di linguistica computazionale "Antonio Zampolli" - ILC -
dc.authority.people Attardi Giuseppe it
dc.authority.people Basile Valerio it
dc.authority.people Bosco Cristina it
dc.authority.people Caselli Tommaso it
dc.authority.people Dell'Orletta Felice it
dc.authority.people Montemagni Simonetta it
dc.authority.people Patti Viviana it
dc.authority.people Simi Maria it
dc.authority.people Sprugnoli Rachele it
dc.collection.id.s b3f88f24-048a-4e43-8ab1-6697b90e068e *
dc.collection.name 01.01 Articolo in rivista *
dc.contributor.appartenenza Istituto di linguistica computazionale "Antonio Zampolli" - ILC *
dc.contributor.appartenenza.mi 918 *
dc.date.accessioned 2024/02/20 07:40:11 -
dc.date.available 2024/02/20 07:40:11 -
dc.date.issued 2015 -
dc.description.abstracteng Shared task evaluation campaigns represent a well established form of competitive evaluation, an important opportunity to propose and tackle new challenges for a specific research area and a way to foster the development of benchmarks, tools and resources. The advantages of this approach are evident in any experimental field, including the area of Natural Language Processing. An outlook on state-of-the-art language technologies for Italian can be obtained by reflecting on the results of the recently held workshop "Evaluation of NLP and Speech Tools for Italian", EVALITA 2014. The motivations underlying individual shared tasks, the level of knowledge and development achieved within each of them, the impact on applications, society and economy at large as well as directions for future research will be discussed from this perspective. -
dc.description.affiliations Univ Pisa; Univ Groningen; Univ Turin; Vrije Univ Amsterdam; CNR; Univ Trento -
dc.description.allpeople Attardi, Giuseppe; Basile, Valerio; Bosco, Cristina; Caselli, Tommaso; Dell'Orletta, Felice; Montemagni, Simonetta; Patti, Viviana; Simi, Maria; Sprugnoli, Rachele -
dc.description.allpeopleoriginal Attardi, Giuseppe; Basile, Valerio; Bosco, Cristina; Caselli, Tommaso; Dell'Orletta, Felice; Montemagni, Simonetta; Patti, Viviana; Simi, Maria; Sprugnoli, Rachele -
dc.description.fulltext none en
dc.description.numberofauthors 9 -
dc.identifier.doi 10.3233/IA-150076 -
dc.identifier.isi WOS:000358145300005 -
dc.identifier.uri https://hdl.handle.net/20.500.14243/333938 -
dc.language.iso eng -
dc.relation.firstpage 43 -
dc.relation.issue 1 -
dc.relation.lastpage 61 -
dc.relation.numberofpages 19 -
dc.relation.volume 9 -
dc.subject.keywords Evaluation Campaign -
dc.subject.keywords Natural Language Processing -
dc.subject.keywords Dependency Parsing -
dc.subject.keywords Sentiment Analysis -
dc.subject.keywords Temporal Processing -
dc.subject.singlekeyword Evaluation Campaign *
dc.subject.singlekeyword Natural Language Processing *
dc.subject.singlekeyword Dependency Parsing *
dc.subject.singlekeyword Sentiment Analysis *
dc.subject.singlekeyword Temporal Processing *
dc.title State of the Art Language Technologies for Italian: The EVALITA 2014 Perspective en
dc.type.driver info:eu-repo/semantics/article -
dc.type.full 01 Contributo su Rivista::01.01 Articolo in rivista it
dc.type.miur 262 -
dc.type.referee Sì, ma tipo non specificato -
dc.ugov.descaux1 366713 -
iris.isi.extIssued 2015 -
iris.isi.extTitle State of the Art Language Technologies for Italian: The EVALITA 2014 Perspective -
iris.orcid.lastModifiedDate 2024/04/24 17:25:49 *
iris.orcid.lastModifiedMillisecond 1713972349999 *
iris.sitodocente.maxattempts 3 -
iris.unpaywall.bestoahost publisher *
iris.unpaywall.bestoaversion publishedVersion *
iris.unpaywall.doi 10.3233/ia-150076 *
iris.unpaywall.hosttype publisher *
iris.unpaywall.isoa true *
iris.unpaywall.journalisindoaj false *
iris.unpaywall.landingpage https://doi.org/10.3233/ia-150076 *
iris.unpaywall.metadataCallLastModified 08/04/2026 07:31:30 -
iris.unpaywall.metadataCallLastModifiedMillisecond 1775626290883 -
iris.unpaywall.oastatus bronze *
iris.unpaywall.pdfurl https://content.iospress.com:443/download/intelligenza-artificiale/ia076?id=intelligenza-artificiale%2Fia076 *
isi.authority.ancejournal INTELLIGENZA ARTIFICIALE###1724-8035 *
isi.category EP *
isi.contributor.affiliation University of Pisa -
isi.contributor.affiliation University of Groningen -
isi.contributor.affiliation University of Turin -
isi.contributor.affiliation Vrije Universiteit Amsterdam -
isi.contributor.affiliation Consiglio Nazionale delle Ricerche (CNR) -
isi.contributor.affiliation Consiglio Nazionale delle Ricerche (CNR) -
isi.contributor.affiliation University of Turin -
isi.contributor.affiliation University of Pisa -
isi.contributor.affiliation University of Trento -
isi.contributor.country Italy -
isi.contributor.country Netherlands -
isi.contributor.country Italy -
isi.contributor.country Netherlands -
isi.contributor.country Italy -
isi.contributor.country Italy -
isi.contributor.country Italy -
isi.contributor.country Italy -
isi.contributor.country Italy -
isi.contributor.name Giuseppe -
isi.contributor.name Valerio -
isi.contributor.name Cristina -
isi.contributor.name Tommaso -
isi.contributor.name Felice -
isi.contributor.name Simonetta -
isi.contributor.name Viviana -
isi.contributor.name Maria -
isi.contributor.name Rachele -
isi.contributor.researcherId ELC-4737-2022 -
isi.contributor.researcherId ABD-2357-2020 -
isi.contributor.researcherId AAM-6450-2020 -
isi.contributor.researcherId HDN-3839-2022 -
isi.contributor.researcherId AAX-1864-2020 -
isi.contributor.researcherId B-8000-2015 -
isi.contributor.researcherId ABD-9967-2020 -
isi.contributor.researcherId GCM-4661-2022 -
isi.contributor.researcherId DYW-4589-2022 -
isi.contributor.subaffiliation Dipartimento Informat -
isi.contributor.subaffiliation Ctr Language & Cognit Groningen -
isi.contributor.subaffiliation Dipartimento Informat -
isi.contributor.subaffiliation CLTL -
isi.contributor.subaffiliation Ist Linguist Computaz Antonio Zampolli -
isi.contributor.subaffiliation Ist Linguist Computaz Antonio Zampolli -
isi.contributor.subaffiliation Dipartimento Informat -
isi.contributor.subaffiliation Dipartimento Informat -
isi.contributor.subaffiliation FBK -
isi.contributor.surname Attardi -
isi.contributor.surname Basile -
isi.contributor.surname Bosco -
isi.contributor.surname Caselli -
isi.contributor.surname Dell'Orletta -
isi.contributor.surname Montemagni -
isi.contributor.surname Patti -
isi.contributor.surname Simi -
isi.contributor.surname Sprugnoli -
isi.date.issued 2015 *
isi.description.abstracteng Shared task evaluation campaigns represent a well established form of competitive evaluation, an important opportunity to propose and tackle new challenges for a specific research area and a way to foster the development of benchmarks, tools and resources. The advantages of this approach are evident in any experimental field, including the area of Natural Language Processing. An outlook on state-of-the-art language technologies for Italian can be obtained by reflecting on the results of the recently held workshop "Evaluation of NLP and Speech Tools for Italian", EVALITA 2014. The motivations underlying individual shared tasks, the level of knowledge and development achieved within each of them, the impact on applications, society and economy at large as well as directions for future research will be discussed from this perspective. *
isi.description.allpeopleoriginal Attardi, G; Basile, V; Bosco, C; Caselli, T; Dell'Orletta, F; Montemagni, S; Patti, V; Simi, M; Sprugnoli, R; *
isi.document.sourcetype WOS.ESCI *
isi.document.type Article *
isi.document.types Article *
isi.identifier.doi 10.3233/IA-150076 *
isi.identifier.eissn 2211-0097 *
isi.identifier.isi WOS:000358145300005 *
isi.journal.journaltitle INTELLIGENZA ARTIFICIALE *
isi.journal.journaltitleabbrev INTELL ARTIF *
isi.language.original English *
isi.publisher.place NIEUWE HEMWEG 6B, 1013 BG AMSTERDAM, NETHERLANDS *
isi.relation.firstpage 43 *
isi.relation.issue 1 *
isi.relation.lastpage 61 *
isi.relation.volume 9 *
isi.title State of the Art Language Technologies for Italian: The EVALITA 2014 Perspective *
Appare nelle tipologie: 01.01 Articolo in rivista
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/333938
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? 5
social impact