This paper presents a comparative and critical documentary analysis of the evaluation criteria adopted in the CNR Senior Researcher competition considering CoARA principles. It integrates a descriptive assessment of the structure of the criteria with a critical examination of their implementation across the 35 disciplinary areas. The results reveal a shared conceptual framework, alongside significant variability in practical application. In particular, the analysis highlights differences in the use of bibliometric indicators, the recognition of non-traditional research outputs, and the internal consistency of evaluation procedures. Humanities and social sciences generally show stronger alignment with content-based and qualitative evaluation approaches, whereas scientific and technological areas tend to combine broader output recognition with a more structured use of journal-based indicators. These findings suggest that disciplinary contexts play a key role in shaping how general principles of responsible research assessment are interpreted and operationalized. Future work should integrate outcome-based validation.

Applying CoARA Principles in the CNR Senior Researcher Competition: A Comparative and Critical Analysis Across Disciplinary Area

Roberto Salzano;Giorgio Luciano;Giuseppe Marsala;Salvatore Aronica;Fiorella Sarubbi
2026

Abstract

This paper presents a comparative and critical documentary analysis of the evaluation criteria adopted in the CNR Senior Researcher competition considering CoARA principles. It integrates a descriptive assessment of the structure of the criteria with a critical examination of their implementation across the 35 disciplinary areas. The results reveal a shared conceptual framework, alongside significant variability in practical application. In particular, the analysis highlights differences in the use of bibliometric indicators, the recognition of non-traditional research outputs, and the internal consistency of evaluation procedures. Humanities and social sciences generally show stronger alignment with content-based and qualitative evaluation approaches, whereas scientific and technological areas tend to combine broader output recognition with a more structured use of journal-based indicators. These findings suggest that disciplinary contexts play a key role in shaping how general principles of responsible research assessment are interpreted and operationalized. Future work should integrate outcome-based validation.
2026
Istituto per il Sistema Produzione Animale in Ambiente Mediterraneo - ISPAAM
Istituto sull'Inquinamento Atmosferico - IIA - Sede Secondaria Firenze
Istituto di Scienze e Tecnologie Chimiche "Giulio Natta" - SCITEC - Sede Secondaria Genova
Istituto per lo studio degli impatti Antropici e Sostenibilità in ambiente marino - IAS - Sede Secondaria Capo Granitola
Istituto di iNgegneria del Mare - INM (ex INSEAN) - Sede Secondaria Palermo
CoARA
research assessment, CNR, senior researcher competition, disciplinary differences, qualitative evaluation, responsible metrics
File in questo prodotto:
File Dimensione Formato  
Applying CoARA Principles in the CNR Senior Researcher Competition.pdf

accesso aperto

Tipologia: Versione Editoriale (PDF)
Licenza: Creative commons
Dimensione 786.12 kB
Formato Adobe PDF
786.12 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/584725
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact