EVALITA 2007, the first edition of the initiative devoted to the evaluation of Natural Language Processing tools for Italian, provided a shared framework where participants' systems had the possibility to be evaluated on five different tasks, namely Part of Speech Tagging (organised by the University of Bologna), Parsing (organised by the University of Torino), Word Sense Disambiguation (organised by CNR-ILC, Pisa), Temporal Expression Recognition and Normalization (organised by CELCT, Trento), and Named Entity Recognition (organised by FBK, Trento). We believe that the diffusion of shared tasks and shared evaluation practices is a crucial step towards the development of resources and tools for Natural Language Processing. Experiences of this kind, in fact, are a valuable contribution to the validation of existing models and data, allowing for consistent comparisons among approaches and among representation schemes. The good response obtained by EVALITA, both in the number of participants and in the quality of results, showed that pursuing such goals is feasible not only for English, but also for other languages.
Evaluation of natural language tools for italian: EVALITA 2007
Cappelli A;
2008
Abstract
EVALITA 2007, the first edition of the initiative devoted to the evaluation of Natural Language Processing tools for Italian, provided a shared framework where participants' systems had the possibility to be evaluated on five different tasks, namely Part of Speech Tagging (organised by the University of Bologna), Parsing (organised by the University of Torino), Word Sense Disambiguation (organised by CNR-ILC, Pisa), Temporal Expression Recognition and Normalization (organised by CELCT, Trento), and Named Entity Recognition (organised by FBK, Trento). We believe that the diffusion of shared tasks and shared evaluation practices is a crucial step towards the development of resources and tools for Natural Language Processing. Experiences of this kind, in fact, are a valuable contribution to the validation of existing models and data, allowing for consistent comparisons among approaches and among representation schemes. The good response obtained by EVALITA, both in the number of participants and in the quality of results, showed that pursuing such goals is feasible not only for English, but also for other languages.| Campo DC | Valore | Lingua |
|---|---|---|
| dc.authority.orgunit | Istituto di linguistica computazionale "Antonio Zampolli" - ILC | - |
| dc.authority.orgunit | Istituto di Scienza e Tecnologie dell'Informazione "Alessandro Faedo" - ISTI | - |
| dc.authority.people | Magnini B | it |
| dc.authority.people | Cappelli A | it |
| dc.authority.people | Tamburini F | it |
| dc.authority.people | Bosco C | it |
| dc.authority.people | Mazzei A | it |
| dc.authority.people | Lombardo V | it |
| dc.authority.people | Bertagna F | it |
| dc.authority.people | Calzolari N | it |
| dc.authority.people | Toral A | it |
| dc.authority.people | Bartalesi Lenzi V | it |
| dc.authority.people | Sprugnoli R | it |
| dc.authority.people | Speranza M | it |
| dc.collection.id.s | 71c7200a-7c5f-4e83-8d57-d3d2ba88f40d | * |
| dc.collection.name | 04.01 Contributo in Atti di convegno | * |
| dc.contributor.appartenenza | Istituto di Scienza e Tecnologie dell'Informazione "Alessandro Faedo" - ISTI | * |
| dc.contributor.appartenenza.mi | 973 | * |
| dc.date.accessioned | 2024/02/19 15:08:26 | - |
| dc.date.available | 2024/02/19 15:08:26 | - |
| dc.date.issued | 2008 | - |
| dc.description.abstracteng | EVALITA 2007, the first edition of the initiative devoted to the evaluation of Natural Language Processing tools for Italian, provided a shared framework where participants' systems had the possibility to be evaluated on five different tasks, namely Part of Speech Tagging (organised by the University of Bologna), Parsing (organised by the University of Torino), Word Sense Disambiguation (organised by CNR-ILC, Pisa), Temporal Expression Recognition and Normalization (organised by CELCT, Trento), and Named Entity Recognition (organised by FBK, Trento). We believe that the diffusion of shared tasks and shared evaluation practices is a crucial step towards the development of resources and tools for Natural Language Processing. Experiences of this kind, in fact, are a valuable contribution to the validation of existing models and data, allowing for consistent comparisons among approaches and among representation schemes. The good response obtained by EVALITA, both in the number of participants and in the quality of results, showed that pursuing such goals is feasible not only for English, but also for other languages. | - |
| dc.description.affiliations | FBK-ricerca scientifica e tecnologica, Povo, Trento, Italy; CNR-ISTI, Pisa - CELCT, Povo, Trento, Italy; Dipartimento di Studi Linguistici e Orientali, Università di Bologna, Bologna, Italy; Dipartimento di Informatica, Università di Torino, Turin, Italy; Dipartimento di Informatica, Università di Torino, Turin, Italy; Dipartimento di Informatica, Università di Torino, Turin, Italy; CNR-ILC, Pisa, Italy; CNR-ILC, Pisa, Italy; CNR-ILC, Pisa, Italy; CELCT, Povo, Trento, Italy; CELCT, Povo, Trento, Italy; FBK-ricerca scientifica e tecnologica, Povo, Trento, Italy | - |
| dc.description.allpeople | Magnini, B; Cappelli, A; Tamburini, F; Bosco, C; Mazzei, A; Lombardo, V; Bertagna, F; Calzolari, N; Toral, A; Bartalesi Lenzi, V; Sprugnoli, R; Speranza, M | - |
| dc.description.allpeopleoriginal | Magnini B.; Cappelli A.; Tamburini F.; Bosco C.; Mazzei A.; Lombardo V.; Bertagna F.; Calzolari N.; Toral A.; Bartalesi Lenzi V.; Sprugnoli R.; Speranza M. | - |
| dc.description.fulltext | open | en |
| dc.description.numberofauthors | 12 | - |
| dc.identifier.isbn | 2-9517408-4-0 | - |
| dc.identifier.scopus | 2-s2.0-85037335397 | - |
| dc.identifier.uri | https://hdl.handle.net/20.500.14243/63164 | - |
| dc.identifier.url | http://www.lrec-conf.org/proceedings/lrec2008/ | - |
| dc.language.iso | eng | - |
| dc.publisher.country | FRA | - |
| dc.publisher.name | European Language Resources Association ELRA | - |
| dc.publisher.place | Paris | - |
| dc.relation.alleditors | Nicoletta calzolari, Khalid Choukri, Bente Maegard | - |
| dc.relation.conferencedate | 28-30 May 2008 | - |
| dc.relation.conferencename | Proceedings of LREC 2008 | - |
| dc.relation.conferenceplace | Marrakech, Morocco | - |
| dc.relation.firstpage | 2536 | - |
| dc.relation.ispartofbook | Proceeding LREC 2008 | - |
| dc.relation.lastpage | 2543 | - |
| dc.relation.numberofpages | 8 | - |
| dc.subject.keywords | Natural language evaluation | - |
| dc.subject.keywords | Standards for LRs | - |
| dc.subject.keywords | Evaluation methodo | - |
| dc.subject.singlekeyword | Natural language evaluation | * |
| dc.subject.singlekeyword | Standards for LRs | * |
| dc.subject.singlekeyword | Evaluation methodo | * |
| dc.title | Evaluation of natural language tools for italian: EVALITA 2007 | en |
| dc.type.driver | info:eu-repo/semantics/conferenceObject | - |
| dc.type.full | 04 Contributo in convegno::04.01 Contributo in Atti di convegno | it |
| dc.type.miur | 273 | - |
| dc.type.referee | Sì, ma tipo non specificato | - |
| dc.ugov.descaux1 | 92169 | - |
| iris.mediafilter.data | 2025/04/18 02:57:07 | * |
| iris.orcid.lastModifiedDate | 2024/07/04 16:06:53 | * |
| iris.orcid.lastModifiedMillisecond | 1720102013517 | * |
| iris.scopus.extIssued | 2008 | - |
| iris.scopus.extTitle | Evaluation of Natural Language tools for Italian: EVALITA 2007 | - |
| iris.scopus.ideLinkStatusDate | 2024/07/04 16:06:53 | * |
| iris.scopus.ideLinkStatusMillisecond | 1720102013523 | * |
| iris.sitodocente.maxattempts | 3 | - |
| scopus.category | 1203 | * |
| scopus.category | 3304 | * |
| scopus.category | 3310 | * |
| scopus.category | 3309 | * |
| scopus.contributor.affiliation | FBK-ricerca Scientifica e Tecnologica | - |
| scopus.contributor.affiliation | CELCT | - |
| scopus.contributor.affiliation | Università di Bologna | - |
| scopus.contributor.affiliation | Università di Torino | - |
| scopus.contributor.affiliation | Università di Torino | - |
| scopus.contributor.affiliation | Consiglio Nazionale delle Ricerche | - |
| scopus.contributor.affiliation | Consiglio Nazionale delle Ricerche | - |
| scopus.contributor.affiliation | Consiglio Nazionale delle Ricerche | - |
| scopus.contributor.affiliation | CELCT | - |
| scopus.contributor.affiliation | CELCT | - |
| scopus.contributor.affiliation | CELCT | - |
| scopus.contributor.affiliation | FBK-ricerca Scientifica e Tecnologica | - |
| scopus.contributor.afid | 60083112 | - |
| scopus.contributor.afid | 113741615 | - |
| scopus.contributor.afid | 60028218 | - |
| scopus.contributor.afid | 60012259 | - |
| scopus.contributor.afid | 60012259 | - |
| scopus.contributor.afid | 60008941 | - |
| scopus.contributor.afid | 60008941 | - |
| scopus.contributor.afid | 60008941 | - |
| scopus.contributor.afid | 113741615 | - |
| scopus.contributor.afid | 113741615 | - |
| scopus.contributor.afid | 113741615 | - |
| scopus.contributor.afid | 60083112 | - |
| scopus.contributor.auid | 22433254600 | - |
| scopus.contributor.auid | 7006976283 | - |
| scopus.contributor.auid | 14018830200 | - |
| scopus.contributor.auid | 7004550793 | - |
| scopus.contributor.auid | 56212864100 | - |
| scopus.contributor.auid | 7003332038 | - |
| scopus.contributor.auid | 55905955400 | - |
| scopus.contributor.auid | 8845912500 | - |
| scopus.contributor.auid | 8839393900 | - |
| scopus.contributor.auid | 55605346400 | - |
| scopus.contributor.auid | 15077007200 | - |
| scopus.contributor.auid | 15077227800 | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.country | Italy | - |
| scopus.contributor.dptid | - | |
| scopus.contributor.dptid | - | |
| scopus.contributor.dptid | 104428229 | - |
| scopus.contributor.dptid | 112950585 | - |
| scopus.contributor.dptid | 112950585 | - |
| scopus.contributor.dptid | - | |
| scopus.contributor.dptid | - | |
| scopus.contributor.dptid | - | |
| scopus.contributor.dptid | - | |
| scopus.contributor.dptid | - | |
| scopus.contributor.dptid | - | |
| scopus.contributor.dptid | - | |
| scopus.contributor.name | B. | - |
| scopus.contributor.name | A. | - |
| scopus.contributor.name | F. | - |
| scopus.contributor.name | C. | - |
| scopus.contributor.name | A. | - |
| scopus.contributor.name | V. | - |
| scopus.contributor.name | F. | - |
| scopus.contributor.name | N. | - |
| scopus.contributor.name | A. | - |
| scopus.contributor.name | V. | - |
| scopus.contributor.name | R. | - |
| scopus.contributor.name | M. | - |
| scopus.contributor.subaffiliation | - | |
| scopus.contributor.subaffiliation | - | |
| scopus.contributor.subaffiliation | Dipartimento di Studi Linguistici e Orientali; | - |
| scopus.contributor.subaffiliation | Dipartimento di Informatica; | - |
| scopus.contributor.subaffiliation | Dipartimento di Informatica; | - |
| scopus.contributor.subaffiliation | Istituto di Linguistica Computazionale; | - |
| scopus.contributor.subaffiliation | Istituto di Linguistica Computazionale; | - |
| scopus.contributor.subaffiliation | Istituto di Linguistica Computazionale; | - |
| scopus.contributor.subaffiliation | - | |
| scopus.contributor.subaffiliation | - | |
| scopus.contributor.subaffiliation | - | |
| scopus.contributor.subaffiliation | - | |
| scopus.contributor.surname | Magnini | - |
| scopus.contributor.surname | Cappelli | - |
| scopus.contributor.surname | Tamburini | - |
| scopus.contributor.surname | Bosco | - |
| scopus.contributor.surname | Mazzei | - |
| scopus.contributor.surname | Lombardo | - |
| scopus.contributor.surname | Bertagna | - |
| scopus.contributor.surname | Calzolari | - |
| scopus.contributor.surname | Toral | - |
| scopus.contributor.surname | Bartalesi Lenzi | - |
| scopus.contributor.surname | Sprugnoli | - |
| scopus.contributor.surname | Speranza | - |
| scopus.date.issued | 2008 | * |
| scopus.description.abstracteng | EVALITA 2007, the first edition of the initiative devoted to the evaluation of Natural Language Processing tools for Italian, provided a shared framework where participants' systems had the possibility to be evaluated on five different tasks, namely Part of Speech Tagging (organised by the University of Bologna), Parsing (organised by the University of Torino), Word Sense Disambiguation (organised by CNR-ILC, Pisa), Temporal Expression Recognition and Normalization (organised by CELCT, Trento), and Named Entity Recognition (organised by FBK, Trento). We believe that the diffusion of shared tasks and shared evaluation practices is a crucial step towards the development of resources and tools for Natural Language Processing. Experiences of this kind, in fact, are a valuable contribution to the validation of existing models and data, allowing for consistent comparisons among approaches and among representation schemes. The good response obtained by EVALITA, both in the number of participants and in the quality of results, showed that pursuing such goals is feasible not only for English, but also for other languages. | * |
| scopus.description.allpeopleoriginal | Magnini B.; Cappelli A.; Tamburini F.; Bosco C.; Mazzei A.; Lombardo V.; Bertagna F.; Calzolari N.; Toral A.; Bartalesi Lenzi V.; Sprugnoli R.; Speranza M. | * |
| scopus.differences | scopus.relation.conferencename | * |
| scopus.differences | scopus.publisher.name | * |
| scopus.differences | scopus.relation.conferencedate | * |
| scopus.differences | scopus.identifier.isbn | * |
| scopus.differences | scopus.description.abstracteng | * |
| scopus.differences | scopus.relation.conferenceplace | * |
| scopus.document.type | cp | * |
| scopus.document.types | cp | * |
| scopus.funding.funders | 501100009890 - Provincia Autonoma di Trento; | * |
| scopus.identifier.isbn | 9782951740846 | * |
| scopus.identifier.pui | 619617054 | * |
| scopus.identifier.scopus | 2-s2.0-85037335397 | * |
| scopus.journal.sourceid | 21100842264 | * |
| scopus.language.iso | eng | * |
| scopus.publisher.name | European Language Resources Association (ELRA) | * |
| scopus.relation.conferencedate | 2008 | * |
| scopus.relation.conferencename | 6th International Conference on Language Resources and Evaluation, LREC 2008 | * |
| scopus.relation.conferenceplace | Palais des Congres Mansour Eddahbi, mar | * |
| scopus.relation.firstpage | 2536 | * |
| scopus.relation.lastpage | 2543 | * |
| scopus.title | Evaluation of Natural Language tools for Italian: EVALITA 2007 | * |
| scopus.titleeng | Evaluation of Natural Language tools for Italian: EVALITA 2007 | * |
| Appare nelle tipologie: | 04.01 Contributo in Atti di convegno | |
File in questo prodotto:
| File | Dimensione | Formato | |
|---|---|---|---|
|
prod_92169-doc_9713.pdf
accesso aperto
Descrizione: Evaluation of natural language tools for italian: EVALITA 2007
Tipologia:
Versione Editoriale (PDF)
Dimensione
334.48 kB
Formato
Adobe PDF
|
334.48 kB | Adobe PDF | Visualizza/Apri |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
