San Francisco Declaration on Research Assessment

{{Short description|2012 manifesto against using the journal impact factor to assess a scientist's work}}

{{Infobox organization

|name = San Francisco Declaration on Research Assessment

|image = SanfraciscoDORAlogo.png

|caption =

|size = 200px

|remarks =

|formation = {{Start date and age|df=yes|2013|05|13}}

|headquarters = International organization

|coords =

|leader_name = Stephen Curry, Imperial College London

|membership =

|website = {{URL|https://sfdora.org/}}

}}

The San Francisco Declaration on Research Assessment (DORA) is a statement that denounces the practice of correlating the journal impact factor to the merits of a specific scientist's contributions. Also according to this statement, this practice creates biases and inaccuracies when appraising scientific research. It also states that the impact factor is not to be used as a substitute "measure of the quality of individual research articles, or in hiring, promotion, or funding decisions".

The declaration originated from the December 2012 meeting of the American Society for Cell Biology, and was published on May 13, 2013, signed by more than 150 scientists and 75 scientific organizations.

{{cite journal

|last=Alberts

|first=Bruce

|author-link=Bruce Alberts

|title=Impact Factor Distortions

|journal=Science

|volume=340

|issue=6134

|pages=787

|date=May 17, 2013

|doi=10.1126/science.1240319|pmid=23687012

|bibcode=2013Sci...340..787A

|doi-access=free

}}

{{cite journal

|last=Van Noorden

|first=Richard

|title=Scientists join journal editors to fight impact-factor abuse

|journal=Nature News Blog

|date=May 16, 2013

|url=http://blogs.nature.com/news/2013/05/scientists-join-journal-editors-to-fight-impact-factor-abuse.html

}}

The American Society for Cell Biology states that, {{as of|2013|05|30|lc=yes}}, there were more than 6,000 individual signatories to the declaration and that the number of scientific organizations "signing on has gone from 78 to 231" within two weeks.

{{cite web

|last = Fleischman

|first = John

|title = Impact Factor Insurrection Catches Fire with Over 6,000 Signatures and Counting

|publisher = The American Society for Cell Biology

|date = May 30, 2013

|url = http://am.ascb.org/ascbpost/index.php/us-news/item/198-impact-factor-insurrection-catches-fire-with-over-6000-signatures-and-counting

}}{{dead link|date=May 2018 |bot=InternetArchiveBot |fix-attempted=yes }} As of 14 December 2017, the number of individual signatories has risen to over 12,800 and the number of scientific organizations to 872.{{cite web|title=Dora - ASCB|url=http://www.ascb.org/dora/|website=ASCB|access-date=14 December 2017|language=en-US}} Some organization signatories in 2017 include the British Library, Nature Research, BioMed Central, Springer Open and Cancer Research UK.{{Cite news|url=http://www.ascb.org/dora/|title=Dora - ASCB|work=ASCB|access-date=2017-05-01|language=en-US}}

DORA is also an organization whose mission is to "advance practical and robust approaches to research assessment globally and across all scholarly disciplines".{{cite web | title=About DORA | website=DORA | date=2024-01-10 | url=https://sfdora.org/about-dora/ | access-date=2024-01-31}}

Motivation

On 16 December 2012, a group of editors and publishers of academic journals gathered at the Annual Meeting of The American Society for Cell Biology in San Francisco to discuss current issues related to how the quality of research output is evaluated and how the primary scientific literature is cited.

The motivation behind the meeting was the consensus that impact factors for many cell biology journals do not accurately reflect the value to the cell biology community of the work published in these journals. The group therefore wanted to discuss how to better align measures of journal and article impact with journal quality.

All the above considerations also extend to other fields and the organizers consider DORA "a worldwide initiative covering all scholarly disciplines". In fact, the declaration has been signed by scientific associations with general scope (such as the American Association for the Advancement of Science and the Academy of Sciences of the Czech Republic), by more specialized associations working in fields quite removed from biology (such as the European Mathematical Society, Geological Society of London, and Linguistic Society of America), as well as by some universities and other general institutions (such as the Higher Education Funding Council for England).

The outcome of the meeting and further discussions was a set of recommendations that is referred to as the San Francisco Declaration on Research Assessment, published in May 2013.

{{cite journal

| doi=10.1242/dmm.012955

| pmid = 23690539

| pmc = 3701204

| url = http://dmm.biologists.org/content/early/2013/05/16/dmm.012955.full.pdf

| title= San Francisco Declaration on Research Assessment

| year=2013

| last1=Cagan

| first1=R.

| journal=Disease Models & Mechanisms| volume = 6

| issue = 4

| pages = 869–870

}}

Signatories

As of 3 May 2021, 2203 organisations and 17,354 individuals had signed the declaration, including universities, research institutes, learned societies and funding bodies from around the world.{{Cite web|title=Signers – DORA|url=https://sfdora.org/signers/|access-date=2021-05-03|website=sfdora.org}} On 20 May 2020 Springer Nature became the largest research publisher to sign the declaration.{{cite web |title=Springer Nature enticed by DORA aura |website=Research Information |url=https://www.researchinformation.info/news/springer-nature-enticed-dora-aura |access-date=2020-06-09}}

Implementation

In November 2019, Dutch universities and research funders announced the introduction of a new system of research recognition and reward, based on the DORA principles.{{Cite web

|title=Dutch universities and research funders move away from the impact factor

|url=https://www.scienceguide.nl/2019/11/dutch-universities-and-research-funders-move-away-from-the-impact-factor/

|work=ScienceGuide

|date=18 November 2019

|access-date=22 November 2019

}}

In November 2019, in the context of its roadmap for open science, the French national research agency CNRS announced the introduction of a system of individual assessment of researchers based on the DORA principles.{{Cite web

|title=Feuille de route du CNRS pour la science ouverte

|url=http://www.cnrs.fr/sites/default/files/press_info/2019-11/Plaquette_ScienceOuverte.pdf#page=7

|access-date=27 November 2019

}}

In March 2021, in the context of a reorganization, the university of Liverpool used the field-weighted citation-impact metric for determining which faculty jobs were at risk of being cut. This happened although that university was a signatory of DORA. This prompted the DORA organization, as well as the authors of the Leiden Manifesto, to contact the university for raising concerns.{{cite journal | last=Else | first=Holly | title=Row erupts over university's use of research metrics in job-cut decisions | journal=Nature | publisher=Springer Science and Business Media LLC | date=2021-03-25 | volume=592 | issue=7852 | issn=0028-0836 | doi=10.1038/d41586-021-00793-7 | page=19| pmid=33767466 | bibcode=2021Natur.592...19E | doi-access=free }}

In June 2021, Utrecht University announced that it would no longer use the impact factor in hiring and promotion decisions. This decision was partly inspired by the DORA declaration, which the university had signed in 2019.{{cite journal | last=Woolston | first=Chris | title=Impact factor abandoned by Dutch university in hiring and promotion decisions | journal=Nature | publisher=Springer Science and Business Media LLC | date=2021-06-25 | volume=595 | issue=7867 | issn=0028-0836 | doi=10.1038/d41586-021-01759-5 | page=462| pmid=34172959 | bibcode=2021Natur.595..462W | s2cid=235647170 | doi-access=free }}

Activities of the organization

File:Introducing Reformscape from DORA.webm

DORA is working on Project TARA (Tools to Advance Research Assessment), which aims to "facilitate the development of new policies and practices for academic career assessment".{{cite web | title=Project TARA | website=DORA | date=2024-01-29 | url=https://sfdora.org/project-tara/ | access-date=2024-01-31}}

As part of Project TARA, DORA has launched the database Reformscape, which collates policies on research assessment from research institutions.{{cite journal | last=Owens | first=Brian | title=How to make academic hiring fair: database lists innovative policies | journal=Nature | publisher=Nature Publishing Group | date=2024-01-30 | doi=10.1038/d41586-024-00273-8 | s2cid=267333016 | url=https://www.nature.com/articles/d41586-024-00273-8 | access-date=2024-01-31}}