Overcoming barriers to computational reproducibility

Hornung, Roman and Németh, László and Zadorozhnyi, Oleksandr and Ullmann, Theresa and Kammer, Michael and Killick, Rebecca and Paciorek, Christopher and Chiquet, Julien and Herrmann, Moritz and Batinović, Lucija and Carlsson, Rickard and Neuvial, Pierre and Hejblum, Boris and Wrobel, Julia and Boulesteix, Anne-Laure and Tabelow, Karsten (2026) Overcoming barriers to computational reproducibility. Royal Society Open Science, 13 (6): 252489. ISSN 2054-5703

Text (rsos.252489.pdf)
rsos.252489.pdf - Published Version
Available under License Creative Commons Attribution.
Download (300kB)

Abstract

Computational reproducibility, the possibility for independent researchers to exactly reproduce published empirical results, is fundamental to science. Despite its importance, the proportion of research articles aiming for reproducibility remains low and uneven across disciplines. Barriers include a perceived lack of incentives for researchers and journals, practical challenges in preparing reproducible materials, and the absence of harmonized standards of reproducibility processes and requirements by journals. Existing guidance is often highly technical, reaching mainly those already engaged with reproducible research. In this paper, we first synthesize evidence on the benefits of reproducibility for both authors and journals. Drawing on our extensive experience in reproducibility checking at various journals, we then put forward concise, pragmatic guidelines and the REPRO Checklist for creating reproducible analyses across disciplines. We further review current reproducibility policies of selected journals, illustrating the substantial heterogeneity in requirements and procedures. Motivated by the latter, we propose conceptual foundations for a harmonized multi-tier system of reproducibility standards that could support transparent, consistent assessment across journals and research communities. Our goal as journal (reproducibility) editors and contributors to the Mathematical Research Data Initiative is to encourage broader adoption of reproducibility practices, in particular by lowering practical barriers for authors and journals.