FAQ for CoARA / ARRA

The Agreement on Reforming Research Assessment (ARRA) sets a shared direction for improving the assessment of research, researchers, and research-performing organisations. It calls for recognizing the full range of outputs, tasks, and activities that contribute to high-quality research. ARRA outlines a set of principles and commitments that signatory organisations agree to uphold. Read the full agreement here: 

Read the full agreement here.

CoARA membership is open to research-performing and research-funding organisations. More than 800 institutions have signed the agreement. In Denmark, signatories currently include universities, university colleges, and public and private research funding bodies.  

Find an up-to-date list of signatories here

If you have any questions or comments regarding Independent Research Fund Denmark’s work with ARRA, you are welcome to contact us at: arra@ufm.dk. 

Independent Research Fund Denmark has signed ARRA because research is essential for preparing society for the future. To ensure that Danish research continues to maintain the highest academic standards, the fund is committed to creating the best possible conditions for supporting excellent researchers at all career stages in Denmark. At the heart of this commitment is the pursuit of research quality and groundbreaking potential. Achieving this requires funding across a broad spectrum of research types, research talent, and research outputs. ARRA serves as a lever to ensure that the fund’s practices support this ambition. At the same time, the agreement is broadly supported and enjoys strong momentum, enabling coordinated efforts across the research landscape both nationally and internationally. This increases the potential for meaningful change for research and researchers alike.

The fund sees ARRA as an opportunity to conduct a general review of its processes and practices. The implementation of the agreement will, among other things, lead to adjustments in assessment procedures, increased transparency in the fund’s work, and closer dialogue with other stakeholders in the research ecosystem in Denmark and abroad

Read the action plan outlining the fund's initial areas of focus here.

The issues raised by ARRA are persistent. Although many organisations are working towards reform, progress is gradual. As a public funding body, the fund has a particular responsibility to promote sound assessment practices to ensure that public investments in research yield the greatest possible benefit. There is a growing need for new approaches to complex scientific and societal challenges, and to ensure that research outputs are accessible, reusable, and reliable. At the same time, the complexity of research tasks has increased, making knowledge sharing, tool development, and openness to collaboration ever more important. The range of relevant research outputs has also become more diverse. In recent decades, there has been a marked increase in the use of quantitative metrics in research assessment. Overemphasis on publication-based metrics has had unintended consequences, incentivizing a focus on specific tasks or favoring certain types of researchers. There is, therefore, a need for systemic change. While the fund's assessment practices are already firmly grounded in qualitative evaluation, ARRA presents a valuable opportunity to conduct a thorough review of them.

The changes will affect how applications are written. For example, there may be new requirements for the project description, a revised CV format, and a new format for the publication list, among others. These changes are intended to support a broader assessment of both the project and the applicant. Independent Research Fund Denmark will communicate any changes clearly and openly in connection with its calls for proposals. The earliest expected implementation of new requirements is in 2026.   

You can stay informed by subscribing to the fund's newsletter (in Danish only), or by contacting us at arra@ufm.dk. 

The fund will not make fundamental changes to the way applications are assessed. However, adjustments will be made to align processes more closely with the principles of the agreement. The fund will work toward ensuring that formats and templates are, where relevant, similar across funding bodies. Nevertheless, harmonization is not the primary goal. 

You can stay updated through the fund's newsletter (in Danish only)  og by contacting us af arra@ufm.dk.  

The Fund’s work with ARRA will run from 2024 through 2027. Some initiatives, such as the transparency policy, are already available on the fund’s website.  Others, including new templates for CVs and publication lists, are scheduled for later in the project period and are expected to be introduced no earlier than 2026.

If you are currently preparing an application for an upcoming call, you can be assured that the guidelines and procedures stated in that specific call remain valid. Any changes to assessment practices will be announced clearly and well in advance. Updated requirements, such as those regarding project descriptions or CVs, will always be specified in the call for applications.

You are always welcome to send your input to: arra@ufm.dk. You are also encouraged to take your own initiative, such as organizing meetings, giving presentations, or sharing information about ARRA, especially if your institution is a signatory to the agreement.

The network serves primarily as a forum for sharing knowledge and experiences related to the implementation of the agreement and other aspects of research assessment. It is also intended to foster collaboration and coordination among relevant stakeholders to ensure that any changes are implemented jointly. Meaningful progress in research assessment can only be achieved through collective efforts across research-performing and research-funding organisations.

Currently, the network includes CoARA contact persons and other relevant administrative staff from Danish research-funding organisations, university colleges, and universities. Most of the participating institutions have either signed the ARRA or are actively considering it. The network is presently coordinated by Villum Foundation, Aalborg University, and Independent Research Fund Denmark.

If you are interested in co-organizing events, giving a presentation, or suggesting topics for discussion, your input is very welcome. Please contact us at arra@ufm.dk. 

The network builds on earlier meetings held with universities and funding bodies regarding CoARA. Initially, organisations that have signed the agreement or have actively reached out were invited to participate.

If you would like to learn more, please contact us at arra@ufm.dk.The network also welcomes suggestions for relevant topics or presentations from organisations not currently involved.

The purpose of developing a new CV format is to support a broader approach to research assessment. Independent Research Fund Denmark aims to recognize the many different tasks and roles that are relevant and essential to research. The most effective way to enable assessors to take this into account is to revise the structure of the information provided by applicants. A new CV format should give applicants the opportunity to better describe their specific contributions to research, as well as other research-relevant activities, so that these can be considered in the evaluation process.

There are indeed differences between the CV requirements of various funding organisations, and the fund is fully aware that introducing a new format may increase the workload for applicants. For this reason, the fund is committed to coordinating, as far as possible, with other funders. This includes sharing knowledge and experience through national networks and engaging in dialogue with other European funders, including through CoARA. A common format would, however, require broader coordination across institutions and countries.

The final CV format has not yet been decided, but it is not expected to be a fully narrative CV. However, it is likely that narrative elements will be included.

The aim of introducing a new format for publication lists is to support a broader approach to recognizing research and researchers. Independent Research Fund Denmark wishes to promote an assessment culture that reflects the fundamental values of science such as curiosity, inquiry, risk-taking, openness, transparency, inclusiveness, and reproducibility.

The pursuit of publication in high-impact journals can, in some cases, challenge the quality, relevance, risk tolerance, and diversity of research. A broader approach to research assessment means that traditional academic publications may not be the only relevant output when evaluating a researcher’s qualifications. The content and relevance of the work are more important than the quantity. Other types of research outputs, such as data, experiments, or communication activities aimed at audiences beyond academia, may also be relevant depending on the field. Therefore, it makes sense to allow applicants to include such outputs in their publication lists.

There are differences between publication list formats across funding bodies, and the fund is aware that a new format may create additional work for applicants. However, most funders already use some form of selective publication list. The fund’s intention is that any new format or elements of it should align with the formats used by other funders wherever possible. Coordination takes place through a Danish network where funders share knowledge and experiences, and also through dialogue with other European funders, including via CoARA. A common format would, however, require more extensive coordination.

A quantitative indicator, often referred to as a metric or bibliometric indicator, provides numerical information at the journal or article level. This may include, for example, the number of publications or citations, sometimes combined with calculated impact. Examples include the Journal Impact Factor (JIF), which reflects a journal’s average number of citations over a two-year period, and the h-index, which combines productivity (number of publications) and impact (number of citations) into a single metric. For example, a researcher with an h-index of 6 has published 6 articles, each of which has been cited at least 6 times.

One concern is that the pursuit of publication in high-impact journals can compromise the quality, reliability, diversity, and relevance of research. In addition, a strong focus on publications may overshadow other valuable contributions and uses of research. There is a growing need for an assessment culture that supports the fundamental nature of science, which is curious, exploratory, risk-taking, open, transparent, inclusive, and reproducible.

Independent Research Fund Denmark does not use quantitative indicators as a systematic part of its assessment processes. The fund has introduced a ban on the use of the Journal Impact Factor (JIF) in applications, and assessments are conducted qualitatively based on the submitted application materials. If an applicant includes their h-index in their CV, it may be considered in some cases as a supplementary element when evaluating the applicant’s qualifications, but it is not used as a standard criterion.

Because there is a need to recognize more aspects of a researcher’s work. Publication and peer review remain fundamental pillars of science and are sound mechanisms in their own right. However, what constitutes merit in a research career has become a major topic of international discussion in recent years. Publishing is just one of many essential tasks carried out by researchers, and quantitative metrics are not suitable tools for evaluating overall qualifications.

The fund does not currently use quantitative indicators systematically, so the reforms will not necessarily result in major changes. Nevertheless, ARRA emphasizes that the use of quantitative metrics should be limited as a direct measure of quality and impact. The fund has already phased out the use of Journal Impact Factor, and with regard to other metrics, the focus is on determining what constitutes responsible use.

The aim is not to change the fund’s assessment procedures for their own sake, but rather to review and analyze them. The purpose is to assess whether certain processes can be improved in light of the commitments made under the Agreement on Reforming Research Assessment (ARRA). Reviewing the Fund’s procedures is an ongoing task that will continue even after the implementation period for ARRA has ended.

One key goal is to make the application and assessment processes more transparent and clearer for applicants, not to make them more difficult. The fund will therefore work towards broader recognition of merit and will make systematic use of available knowledge on good assessment practices. It already takes significant time and effort to prepare an application for Independent Research Fund Denmark or other funders. If certain researchers or groups have previously opted out of applying, the Fundhopes to make it clear that it welcomes applications from researchers across all disciplines and regardless of the types of research activities they engage in.

The fund’s assessment practices must be of the highest possible quality. Decisions on funding are already made on a strong academic and professional basis. However, there is always room for improvement, particularly when it comes to reflecting critically on current practices. Training in bias awareness will help prepare both assessors and administrative staff for this. All members of the fund, including the board, research councils, ad hoc review panels, and the administration, will receive training by an external expert in 2026. A plan will also be established to ensure that new members receive ongoing training.

Until now, the fund has not explicitly worked with diversity, consistency, or bias awareness in its assessment practices. Instead, there has been a strong focus on allowing space for field-specific differences and nuance. This remains important. At the same time, there is a growing need to strengthen a shared professional understanding of assessment practices across both the secretariat and reviewers in order to ensure the continued high standard of Danish research.

In general, the training will focus on bias awareness in assessment processes and on providing concrete tools for identifying and mitigating bias. The training will also evolve over time to incorporate new initiatives stemming from the Fund’s commitments under ARRA.

Independent Research Fund Denmark plays a key role in the Danish research funding landscape as one of the primary sources of funding for ideas driven by researcher initiative. As a public fund and part of the Danish public administration, the fund has a particular responsibility to ensure transparency and openness in its activities and internal decision-making processes. By being transparent about its procedures and tools, the fund enables the wider research community, including applicants, to understand how proposals are assessed. The fund limits confidentiality to cases where it is strictly necessary, such as the protection of personal data, researchers’ original ideas, and the assessments of those ideas.

The fund will continuously publish procedural documents and internal guidelines on its website. These materials will be integrated into relevant sections of the site to enhance clarity and accessibility.