With the rapid advances of AI-based tools, the question of whether to use such tools or conventional rule-based tools often arises in many application domains. In this paper, we address this question when considering the issue of ambiguity in requirements documents. For this purpose, we consider GPT-3 that is the third-generation of the Generative Pretrained Transformer language model, developed by OpenAI and we compare its ambiguity detection capability with that of a publicly available rule-based NLP tool on a few example requirements documents.

Rule-based NLP vs ChatGPT in ambiguity detection, a preliminary study

Fantechi A;Gnesi S;
2023

Abstract

With the rapid advances of AI-based tools, the question of whether to use such tools or conventional rule-based tools often arises in many application domains. In this paper, we address this question when considering the issue of ambiguity in requirements documents. For this purpose, we consider GPT-3 that is the third-generation of the Generative Pretrained Transformer language model, developed by OpenAI and we compare its ambiguity detection capability with that of a publicly available rule-based NLP tool on a few example requirements documents.
2023
Istituto di Scienza e Tecnologie dell'Informazione "Alessandro Faedo" - ISTI
Inglese
Ferrari A. et al.
REFSQ-JP 2023
REFSQ 2023 - 29th International Working Conference on Requirement Engineering: Foundation for Software Quality: Posters and Tools
10
https://ceur-ws.org/Vol-3378/
17-20/04/2023
Barcelona, Spain
Ambiguity detection in requirements
ChatGPT
Rule-based NLP tools
2
open
Fantechi A.; Gnesi S.; Semini L.
273
info:eu-repo/semantics/conferenceObject
04 Contributo in convegno::04.01 Contributo in Atti di convegno
File in questo prodotto:
File Dimensione Formato  
prod_482040-doc_198323.pdf

accesso aperto

Descrizione: Rule-based NLP vs ChatGPT in ambiguity detection, a preliminary study
Tipologia: Versione Editoriale (PDF)
Dimensione 271.09 kB
Formato Adobe PDF
271.09 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/457310
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 4
  • ???jsp.display-item.citation.isi??? ND
social impact