We introduce a new coverage measure, called the operational coverage, which is customized to the usage profile (count spectrum) of the entities to be covered. Operational coverage is proposed as an adequacy criterion for operational profile based testing, i.e., to assess the thoroughness of a black box test suite derived from the operational profile. To validate the approach we study the correlation between operational coverage of branches, statements, and functions, and the probability that the next test input will not fail. On the three subjects considered, we observed a moderate correlation in all cases (except a low correlation for function coverage for one subject), and consistently better results than traditional coverage measure.

Does code coverage provide a good stopping rule for operational profile based testing?

Miranda B;Bertolino A
2016

Abstract

We introduce a new coverage measure, called the operational coverage, which is customized to the usage profile (count spectrum) of the entities to be covered. Operational coverage is proposed as an adequacy criterion for operational profile based testing, i.e., to assess the thoroughness of a black box test suite derived from the operational profile. To validate the approach we study the correlation between operational coverage of branches, statements, and functions, and the probability that the next test input will not fail. On the three subjects considered, we observed a moderate correlation in all cases (except a low correlation for function coverage for one subject), and consistently better results than traditional coverage measure.
2016
Istituto di Scienza e Tecnologie dell'Informazione "Alessandro Faedo" - ISTI
978-1-4503-4151-6
Coverage Testing
Operational Coverage
Operational Profile Based Testing
Program Spectra
Relative Coverage
File in questo prodotto:
File Dimensione Formato  
prod_365229-doc_120464.pdf

solo utenti autorizzati

Descrizione: Does code coverage provide a good stopping rule for operational profile based testing?
Tipologia: Versione Editoriale (PDF)
Dimensione 288.83 kB
Formato Adobe PDF
288.83 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
prod_365229-doc_166270.pdf

accesso aperto

Descrizione: Does code coverage provide a good stopping rule for operational profile based testing?
Tipologia: Versione Editoriale (PDF)
Dimensione 293.21 kB
Formato Adobe PDF
293.21 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/359115
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 10
  • ???jsp.display-item.citation.isi??? ND
social impact