The Corona-Eye : Exploring the risks of COVID-19 on fair assessments of Impact for REF2021

Derrick, Gemma and Bayley, Julie (2022) The Corona-Eye : Exploring the risks of COVID-19 on fair assessments of Impact for REF2021. Research Evaluation, 31 (1). pp. 93-103. ISSN 0958-2029

Abstract

This article assesses the risk of two COVID-19-related changes necessary for the expert review of the REF2021’s Impact criterion: the move from face to face (F2F) to virtual deliberation; and the changing research landscape caused by the COVID-19 crisis requiring an extension of deadlines, and accommodation of COVID-19-related mitigation. Peer review in its basic form requires expert debate, where dissenting opinions and non-verbal cues are absorbed into a group deliberative practice and therefore inform outcomes. With a move to deliberations in virtual settings, the most likely current outcome for REF2021 evaluations, the extent that negotiation dynamics necessary in F2F evaluations are diminished and how this limits panellists’ ability to sensitively assess COVID-19 mitigation statements is questioned. This article explores the nature of, and associated capabilities to undertake, complex decision-making in virtual settings around the Impact criterion as well the consequences of COVID-19 on normal Impact trajectories. It examines the risks these changes present for evaluation of the Impact criterion and provides recommendations to offset these risks to enhance discussion and safeguard the legitimacy of evaluation outcomes. This article is also relevant for evaluation processes of academic criteria that require both a shift to virtual, and/or guidance of how to sensitively assess the effect of COVID-19 on narratives of individual, group or organizational performance.