Two scripts for training and testing BERT-like pretrained models on Named Entity Recognition (NER) tasks. Train (finetune) a BERT-based NER model (from Hugging Face or a model stored on your computer) on a dataset formatted in CoNLL-like format. Use the trained model to predict NER tags on test data, getting an evaluation report, or new data, getting a tagged version the data. The scripts handle sequences longer than the maximum length defined by the models by splitting the sequences in multiple chunks with a context overlap.

Named entity recognition with BERT

Esuli A.
2025

Abstract

Two scripts for training and testing BERT-like pretrained models on Named Entity Recognition (NER) tasks. Train (finetune) a BERT-based NER model (from Hugging Face or a model stored on your computer) on a dataset formatted in CoNLL-like format. Use the trained model to predict NER tags on test data, getting an evaluation report, or new data, getting a tagged version the data. The scripts handle sequences longer than the maximum length defined by the models by splitting the sequences in multiple chunks with a context overlap.
2025
Istituto di Scienza e Tecnologie dell'Informazione "Alessandro Faedo" - ISTI
Named entity recognition
Machine Learning
Transformer
File in questo prodotto:
File Dimensione Formato  
bert_ner_README.pdf

accesso aperto

Descrizione: NER with BERT
Tipologia: Altro materiale allegato
Licenza: Creative commons
Dimensione 76.92 kB
Formato Adobe PDF
76.92 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/536705
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact