Interpreting the outcomes of research assessments: A geometrical approach

作者:

Highlights:

• Geometric approach for the comparison of frequency distributions of ordinal variables.

• Assigning a single score to research assessments given as repartitions in merit classes of scientific publications.

• Distance measure defined in the n-simplex following the path toward the best possible scenario in the frequency repartition.

• Definition of a geometric-statistical score for building a fair ranking of institutions inhomogeneous in their composition.

• Computation of the geometric score using Monte Carlo simulations.

• Case study: application to the Italian Quality Research Evaluation.

摘要

•Geometric approach for the comparison of frequency distributions of ordinal variables.•Assigning a single score to research assessments given as repartitions in merit classes of scientific publications.•Distance measure defined in the n-simplex following the path toward the best possible scenario in the frequency repartition.•Definition of a geometric-statistical score for building a fair ranking of institutions inhomogeneous in their composition.•Computation of the geometric score using Monte Carlo simulations.•Case study: application to the Italian Quality Research Evaluation.

论文关键词:Ordinal variables,Discrepancy measures,Simplex,Geometric score,Research evaluation

论文评审过程:Received 25 August 2021, Revised 12 January 2022, Accepted 13 January 2022, Available online 2 February 2022, Version of Record 2 February 2022.

论文官网地址:https://doi.org/10.1016/j.joi.2022.101254