2026-05-10T23:23:57Zhttps://iris.cnr.it/oai/request

oai:iris.cnr.it:20.500.14243/1282722024-06-08T13:40:34Zcom_20.500.14243_46com_20.500.14243_21col_20.500.14243_47ou_ou239

Automatic Creation of Quality Multi-Word Lexica from Noisy Text Data Francesca Frontini Valeria Quochi Francesco Rubino Frontini, Francesca Quochi, Valeria Rubino, Francesco Lexical induction multi-word extraction web-based distributed platform noisy data This paper describes the design of a tool for the automatic creation of multi-word lexica that is deployed as a web service and runs on automatically web-crawled data within the framework of the PANACEA platform. The main purpose of our task is to provide a (computationally "light") tool that creates a full high quality lexical resource of multi-word items. Within the platform, this tool is typically inserted in a work flow whose first step is automatic web-crawling. Therefore, the input data of our lexical extractor is intrinsically noisy. The paper evaluates the capacity of the tool to deal with noisy data, and in particular with texts containing a significant amount of duplicated paragraphs. The accuracy of the extraction of multi-word expressions from the original crawled corpus is compared to the accuracy of the extraction from a later "de-duplicated" version of the corpus. The paper shows how our method can extract with sufficiently good precision also from the original, noisy crawled data. The output of our tool is a multi-word lexicon formatted and encoded in XML according to the Lexical Mark-up Framework. 2012 info:eu-repo/semantics/conferenceObject https://hdl.handle.net/20.500.14243/128272 info:eu-repo/semantics/altIdentifier/isbn/978-1-4503-1919-5 http://www.kde.cs.tut.ac.jp/~aono/pdf/COLING2012/AND/pdf/AND04.pdf eng ispartofbook:Proceedings of the Sixth Workshop on Analytics for Noisy Unstructured Text Data AND 2012 info:eu-repo/grantAgreement/EC/FP7/Platform for Automatic, Normalized Annotation and Cost-Effective Acquisition of Language Resources for Human Language Technologies ACM, Association for computing machinery country:USA place:New York