The use of citation numbers for the assessment of research quality has become highly relevant in modern science. Although it is well known that scientific domains strongly differ in terms of citation rates, bibliometric indicators currently used in research assessment are often based on the sole use of raw citation numbers. This necessarily leads to unfair evaluation procedures, especially in cross-disciplinary contexts. For this reason, there is an increasing trend towards the formulation of normalization procedures able to suppress disproportions in citation numbers among scientific domains, and thus to lead to more fair cross-disciplinary evaluation criteria. In this paper, we rigorously test the performance of several field normalization procedures devoted to this purpose. We find that four procedures discussed in the literature do worse than the usual normalization with field averages. The latter drastically reduces citation disproportions among scientific disciplines. Finally, we find that a recently introduced two-parameters normalization scheme reduction.

Quantitative evaluation of alternative field normalization procedures

Claudio Castellano;
2013

Abstract

The use of citation numbers for the assessment of research quality has become highly relevant in modern science. Although it is well known that scientific domains strongly differ in terms of citation rates, bibliometric indicators currently used in research assessment are often based on the sole use of raw citation numbers. This necessarily leads to unfair evaluation procedures, especially in cross-disciplinary contexts. For this reason, there is an increasing trend towards the formulation of normalization procedures able to suppress disproportions in citation numbers among scientific domains, and thus to lead to more fair cross-disciplinary evaluation criteria. In this paper, we rigorously test the performance of several field normalization procedures devoted to this purpose. We find that four procedures discussed in the literature do worse than the usual normalization with field averages. The latter drastically reduces citation disproportions among scientific disciplines. Finally, we find that a recently introduced two-parameters normalization scheme reduction.
2013
Istituto dei Sistemi Complessi - ISC
978-3-20003-135-7
Bibliometric indicators
Cross-disciplinary
Evaluation criteria
Modern science
Quantitative evaluation
File in questo prodotto:
File Dimensione Formato  
prod_287847-doc_82611.pdf

solo utenti autorizzati

Descrizione: Quantitative evaluation of alternative field normalization procedures
Tipologia: Versione Editoriale (PDF)
Licenza: NON PUBBLICO - Accesso privato/ristretto
Dimensione 191.29 kB
Formato Adobe PDF
191.29 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/225092
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? ND
social impact