Peer review lies at the core of current scientic research. It is composed of a set of social norms, practices and processes that con-nect the abstract scientic method with the society of people that apply the method. As a social construct, peer review should be understood by building theory-informed models and comparing them with data collec-tion. Both these activities are evolving in the era of automated com-putation and communication: new modeling tools and large bodies of data become available to the interested scholar. In this paper, starting from abstract principles, we develop and present a model of the peer review process. We also propose a working implementation of a subset of the general model, developed with Jason, a framework that implements the Belief-Desire-Intention (BDI) model for multi agent systems. After running a set of simulations, varying the initial distribution of reviewer skill, we compare the aggregates that our simplied model produces with recent ndings, showing how for some parameter choice the model can generate data in qualitative agreement with measures

Agent simulation of peer review: the PR-1 model

Paolucci Mario;Conte Rosaria
2012

Abstract

Peer review lies at the core of current scientic research. It is composed of a set of social norms, practices and processes that con-nect the abstract scientic method with the society of people that apply the method. As a social construct, peer review should be understood by building theory-informed models and comparing them with data collec-tion. Both these activities are evolving in the era of automated com-putation and communication: new modeling tools and large bodies of data become available to the interested scholar. In this paper, starting from abstract principles, we develop and present a model of the peer review process. We also propose a working implementation of a subset of the general model, developed with Jason, a framework that implements the Belief-Desire-Intention (BDI) model for multi agent systems. After running a set of simulations, varying the initial distribution of reviewer skill, we compare the aggregates that our simplied model produces with recent ndings, showing how for some parameter choice the model can generate data in qualitative agreement with measures
2012
Istituto di Scienze e Tecnologie della Cognizione - ISTC
978-3-642-28399-4
Peer Review
File in questo prodotto:
File Dimensione Formato  
prod_224987-doc_54637.pdf

solo utenti autorizzati

Descrizione: Agent Simulation of Peer Review: The PR-1 Model
Dimensione 299.17 kB
Formato Adobe PDF
299.17 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/141683
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact