Publishing Reproducible Research Output

We investigated the need to make research outputs more reproducible and how infrastructures can support them

1 September 2020 - 4 November 2021,  00:00 - 00:00, 

PRRO the_alchemist_2013.34.2 (1)
Image: The Alchemist, 1663, Cornelis Bega. Courtesy National Gallery of Art, Washington.

Publishing Reproducible Research Output

Reproducibility and transparency can be regarded (at least in experimental research) as a hallmark of research. The ability to reproduce research results in order to check their reliability is an important cornerstone of research that helps to guarantee the quality of research and to build on existing knowledge. The digital turn has brought more opportunities to document, share and verify research processes and outcomes. Consequently, there is an increasing demand for more transparency with regard to research processes and outcomes. This fits well with the open science agenda requiring, amongst others, open software, open data, and open access to publications even if openness alone does not guarantee reproducibility.

The purpose of this Knowledge Exchange activity was to explore current practices and barriers in the area of research reproducibility, with a focus on the publication and dissemination stage. We wanted to determine how technical and social infrastructures can support future developments in this area. In this work, we defined research reproducibility as cases where data and procedures shared by the authors of a study are used to obtain the same results as in their original work.

We captured the views of research funding organisations, research performing organisations, learned societies, researchers, academic publishers and infrastructure and service providers. We did a comprehensive literature review and a series of interviews and focus groups with a total of 51 contributors. The results of our activity give answers to the following questions:

  • What are the main benefits and barriers of publishing reproducible research outputs?
  • What are the roles of the different stakeholders involved?
  • How expensive are reproducibility checks?
  • What kind of digital tools and infrastructure are needed to publish reproducible research output?

Please check out our slide deckfinal report and executive summary as well as our project materials.

The Task & Finish Group for Publishing Reproducible Research Output

The activity was led by Juliane Kant (DFG) and Anna Mette Morthorst (DeiC) as KE Group leads and Birgit Schmidt (Göttingen State and University Library) and Jeroen Sondervan (Utrecht University) as expert leads.

A full list of all participants of the Task & Finish group who contributed to this activity is available at the end of this page.

Stakeholder collaboration is needed to continue developing reproducible publication practices. All players from the individual researcher to national and international bodies have a role to play, including in the context of policy development and implementation.

Knowledge Exchange, 2021. The Art of Publishing Reproducible Research Outputs: Supporting emerging practices through cultural and technological innovation. https://doi.org/10.5281/zenodo.5521077

Key findings / outcome report download

The Art of Publishing Reproducible Research Outputs: Supporting emerging practices through cultural and technological innovation
Open Access
4 November 2021

The Art of Publishing Reproducible Research Outputs: Supporting emerging practices through cultural and technological innovation

Purpose: Report

DOI: https://doi.org/10.5281/zenodo.5521077

File type: PDF

Download
Executive Summary: The Art of Publishing Reproducible Research Outputs: Supporting emerging practices through cultural and technological innovation
Open Access
4 November 2021

Executive Summary: The Art of Publishing Reproducible Research Outputs: Supporting emerging practices through cultural and technological innovation

Purpose: Executive Summary

DOI: https://doi.org/10.5281/zenodo.5639384

File type: PDF

Download
Publishing Reproducible Research Outputs - Literature findings
Open Access
8 April 2021

Publishing Reproducible Research Outputs - Literature findings

Purpose: Slide Deck

DOI: https://doi.org/10.5281/zenodo.4675457

File type: PDF

Download


Participants