Knowledge Exchange Openness Profile

As part of our work on Open Scholarship, we are working to raise awareness of the lack of incentivising mechanisms & research evaluation practices for open scholarship contributions, and work towards a possible solution; through development of an 'Openness Profile'

1 January 2019 - 1 June 2020,  00:00 - 00:00, 

KE Openness Profile - Defining the Concepts Jan 2020

Part of KE's work on Open Scholarship aims to enhance the evaluation of research and researchers. This currently does not cover recognition of non-academic contributions to make Open Scholarship work, such as activities to open up and curate data for re-use, or making research results findable and available. Our approach is to raise more awareness on the lack of recognition in current evaluation practice and work towards a possible solution, through the development of an 'Openness Profile'.

The KE Open Scholarship Research Evaluation task & finish group works on the awareness issue, listing all academic and non-academic contributions that are essential to Open Scholarship and should be recognised when evaluating research. The group also works on the Openness Profile, a tool that is meant to allow evaluation of currently ignored contributions that are essential for Open Scholarship. For the development of the Openness Profile we seek involvement of various key stakeholders and alignment with current identifiers such as DOI and ORCID iD.

By demonstrating the immaturity of current research evaluation practice, and by developing the Openness Profile tool, KE supports researchers as well as non-researchers to get credit for all their contributions that make Open Scholarship possible. Our ambition is that recognition of these essential activities becomes part of standard research evaluation routine.

Interim report - Openness Profile: Defining the Concepts

We have documented our ongoing investigation into the need for and value of new evaluation approaches of people conducting open scholarship and their outputs, in the newly published report 'Openness Profile: Defining the Concepts'.

The report provides an extensive overview of strategies, barriers, and community needs regarding openness and explores what contributions an Openness Profile, as introduced in this report, can make to enable desired openness and fairer assessment in research.

It is based on interviews conducted with 19 research contributors, both research conductors as well as research supporting professionals. The focus areas of the interviews were strategies, mandates, skills, community norms, appraisals/evaluations, non-individual profiles, barriers, incentives, and feedback on the OP concept itself.

The study showed that:

  • The OP could serve the purposes of being part of their annual review, informing decision making or creating incentives/metrics at their organization.
  • There is a frustration with current incentive structures and cultural inertia is very common, which translated into a desire for systemic change in how contributions to scholarship are valued and who is credited.
  • It was frequently found that openness is either not currently discussed in detail in interviewees' personal evaluations, or that interviewees had only informal evaluations or none at all.

You can read the full report here.

The next steps for Knowledge Exchange are to test the concept of the Openness Profile further through a workshop with selected stakeholders, taking place in Leiden, the Netherlands in early April 2020. A final report will follow after this workshop, in which we can advise on future advancements in developing the Openness Profile tool.

Members of the KE Open Scholarship Research Evaluation task & finish group

Consultants working on this KE activity:

Key findings / outcome report download

Openness Profile: Defining the Concepts
Open Scholarship
31 January 2020

Openness Profile: Defining the Concepts

Purpose: Report: 10.5281/zenodo.3607579

File type: PDF

Download

A collaboration between

  • dfg
  • csc-it center for science
  • jisc
  • cnrs
  • surf
  • deic