Skip to content
Nicolas Robinson-Garcia
  • Home
  • Projects
    • LeaDing Fellows-MSCA ECOSCI
    • Bibliometría o Barbarie
    • SCI-COMM COVID-19
  • Research topics
    • Altmetrics
    • Open Science
    • Scientific mobility
  • Publications
  • Teaching
  • CV
    • Bio excerpt
    • Extended CV (pdf)
    • Short CV (pdf)
  • Notes
Opinion

Swamped by rankings

  • May 22, 2019
  • by Nicolas Robinson-Garcia

Lately the odds have confronted me with what I thought, was a topic I had left behind: university rankings. Having written my PhD thesis on university rankings, you can imagine how fed up I ended with all this business. Still, the fascination they provoke and the stimulating discussions they lead to (usually criticizing their use) traps me from time to time. While I thought these relapses were anecdotal, funnily, they have concentrated in the last 15 days. First, came the announcement of the release of the 2019 edition of the Leiden Ranking. This year, it includes gender and Open Access indicators. Me being involved in the development of the latter. Then, just a couple of days ago, our paper on Mining university rankings was finally accepted for publication in Research Evaluation and we uploaded an OA version of the manuscript.

Anecdotes aside, I have been reflecting on how university rankings have evolved since 2014, when I stopped following them closely. What we show in the paper is not surprising, although evidence was missing. Namely, that university rankings, no matter the formula they use or the weights given to the considered variables, end up measuring number of publications and partly, normalized citation impact. And that in fact, by simply sorting universities by their H-Index, you get a very close image of what any university ranking looks like. This strong reliance on publication and citation indicators has led to strong criticisms on which I will not go now, but that can be easily resumed by stating that universities do more things other than producing publications. Collini’s book What are universities for? reflecting on universities’ mission, gives a good account on the impossibility of both, measuring institutions’ performance with a single indicator, and comparing them later with each other. So given the strength of such positions, by the end of my PhD I saw this topic of research as exhausted. Not much to report on it.

grounding politics in statistics is elitist, undemocratic and oblivious to people’s emotional investments in their community and nation

William Davies, How statistics lost their power – and why we should fear what comes next

But rankings have been able to respond, maybe not satisfyingly, but at least, respond to such criticisms. Their latest twist have been the creating of new league tables following specific goals. In that sense, the inclusion of these two new indicators by the Leiden Ranking, evidence that a more informative approach which highlights different aspect of universities’ performance, can lead to more thoughtful insights and stimulate discussions among university leaders. The THE Rankings now also include league tables based on the SDGs. And although, the methodology behind them raises important concerns, these movements towards diversity of views and measurements might lead to a more responsible use of metrics (sciento- or otherwise), and move the debate away from the use of numbers to how can numbers be used.

Towards more nuanced altmetric methods and indicators
Premio SCImago al mejor artículo en Documentación #CRECS19
Open Access statistics university rankings

Related articles

Rabietas y pataleos académicos
La financiación de las universidades…
Los resultados del REF2014 del…
Twitter, altmetrics and science communication
Scientific excellence is just one…

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Nullius in verba

(Not on authority)

Recent Posts

  • Understanding the peer review system January 14, 2021
  • Peer Review II – Elaborando la respuesta a revisores November 27, 2020
  • New research line on COVID-19 and scientific communication June 24, 2020
  • Science covers our work on COVID-19 May 27, 2020
  • “Meaningful Data Counts” project has been granted! May 6, 2020

Categories

  • Bibliographies 2
  • Opinion 6
  • Paper notes 3
  • Projects 2
  • SciComm 10
  • Self-promotion 6
  • Uncategorized 2
Theme by Colorlib Powered by WordPress
  • Twitter
  • github
  • Flickr
  • LinkedIn
  • Slideshare