Peer review

{{Short description|Evaluation of work by one or more people of similar competence to the producers of the work}}

{{Redirect|Independent review|the academic journal|The Independent Review}}

{{Other uses}}

{{Use dmy dates|date=April 2021}}

File:ScientificReview.jpg proposal]]

Peer review is the evaluation of work by one or more people with similar competencies as the producers of the work (peers).{{Cite web |title=peer review process |url=https://www.cancer.gov/publications/dictionaries/cancer-terms/def/peer-review-process |access-date=2022-07-05 |website=National Cancer Institute Dictionary of Cancer Terms |language=}} It functions as a form of self-regulation by qualified members of a profession within the relevant field. Peer review methods are used to maintain quality standards, improve performance, and provide credibility. In academia, scholarly peer review is often used to determine an academic paper's suitability for publication.{{cite encyclopedia |last1=Turner |first1=Stephen |last2=McCreery |first2=Gregory |title=Peer Review and Quality Control in Science |encyclopedia=The Blackwell Encyclopedia of Sociology |date=2015 |doi=10.1002/9781405165518.wbeosp015.pub2 |isbn=9781405165518}} Peer review can be categorized by the type of activity and by the field or profession in which the activity occurs, e.g., medical peer review. It can also be used as a teaching tool to help students improve writing assignments.{{Cite journal |last1=Magnifico |first1=Alecia Marie |last2=Woodard |first2=Rebecca |last3=McCarthey |first3=Sarah |date=2019-06-01 |title=Teachers as co-authors of student writing: How teachers' initiating texts influence response and revision in an online space |url=https://www.sciencedirect.com/science/article/pii/S875546151730066X |journal=Computers and Composition |language=en |volume=52 |pages=107–131 |doi=10.1016/j.compcom.2019.01.005 |s2cid=86438229 |issn=8755-4615|url-access=subscription }}

Henry Oldenburg (1619–1677) was a German-born British philosopher who is seen as the 'father' of modern scientific peer review.{{cite web |last=Hatch |first=Robert A. |date=February 1998 |title=The Scientific Revolution: Correspondence Networks |url=http://www.clas.ufl.edu/users/rhatch/pages/03-Sci-Rev/SCI-REV-Home/resource-ref-read/correspond-net/08sr-crrsp.htm |url-status=live |archive-url=https://web.archive.org/web/20090116232845/http://www.clas.ufl.edu/users/rhatch/pages/03-Sci-Rev/SCI-REV-Home/resource-ref-read/correspond-net/08sr-crrsp.htm |archive-date=16 January 2009 |access-date=21 August 2016 |publisher=University of Florida}}{{Cite journal |last=Oldenburg |first=Henry |year=1665 |title=Epistle Dedicatory |journal=Philosophical Transactions of the Royal Society |volume=1 |pages=0 |doi=10.1098/rstl.1665.0001 |s2cid=186211404}}{{cite book |last=Boas Hall |first=Marie |title=Henry Oldenburg: shaping the Royal Society |publisher=Oxford University Press |year=2002 |isbn=978-0-19-851053-6 |location=Oxford |bibcode=2002heol.book.....B |author-link=Marie Boas Hall}} It developed over the following centuries with, for example, the journal Nature making it standard practice in 1973. The term "peer review" was first used in the early 1970s.{{Cite web |last=Wills |first=Matthew |date=2024-07-21 |title=The History of Peer Review Is More Interesting Than You Think |url=https://daily.jstor.org/the-history-of-peer-review-is-more-interesting-than-you-think/ |access-date=2024-07-29 |website=JSTOR Daily |language=en-US}} A monument to peer review has been at the Higher School of Economics in Moscow since 2017.{{Cite journal |last=Schiermeier |first=Quirin |date=2017-05-26 |title=Monument to peer review unveiled in Moscow |url=https://www.nature.com/articles/nature.2017.22060 |journal=Nature |language=en |doi=10.1038/nature.2017.22060 |issn=1476-4687|url-access=subscription }}

Professional

Professional peer review focuses on the performance of professionals, with a view to improving quality, upholding standards, or providing certification. In academia, peer review is used to inform decisions related to faculty advancement and tenure.{{Cite journal |last1=Schimanski |first1=Lesley A. |last2=Alperin |first2=Juan Pablo |date=2018 |title=The evaluation of scholarship in academic promotion and tenure processes: Past, present, and future |journal=F1000Research |volume=7 |pages=1605 |doi=10.12688/f1000research.16493.1 |issn=2046-1402 |pmc=6325612 |pmid=30647909 |doi-access=free }}

A prototype professional peer review process was recommended in the Ethics of the Physician written by Ishāq ibn ʻAlī al-Ruhāwī (854–931). He stated that a visiting physician had to make duplicate notes of a patient's condition on every visit. When the patient was cured or had died, the notes of the physician were examined by a local medical council of other physicians, who would decide whether the treatment had met the required standards of medical care.{{cite journal |last=Spier |first=Ray |year=2002 |title=The history of the peer-review process |journal=Trends in Biotechnology |volume=20 |issue=8 |pages=357–8 |doi=10.1016/S0167-7799(02)01985-6 |pmid=12127284}}

Professional peer review is common in the field of health care, where it is usually called clinical peer review.{{cite journal |last=Dans |first=PE |year=1993 |title=Clinical peer review: burnishing a tarnished image |url=http://www.annals.org/content/118/7/566.full.pdf+html |journal=Annals of Internal Medicine |volume=118 |issue=7 |pages=566–8 |doi=10.7326/0003-4819-118-7-199304010-00014 |pmid=8442628 |archive-url=https://archive.today/20120721025646/http://www.annals.org/content/118/7/566.full.pdf+html |archive-date=2012-07-21 |s2cid=45863865|url-access=subscription }} Further, since peer review activity is commonly segmented by clinical discipline, there is also physician peer review, nursing peer review, dentistry peer review, etc.{{cite journal |author1=Milgrom P |author2=Weinstein P |author3=Ratener P |author4=Read WA |author5=Morrison K |year=1978 |title=Dental Examinations for Quality Control: Peer Review versus Self-Assessment |journal=American Journal of Public Health |volume=68 |issue=4 |pages=394–401 |doi=10.2105/AJPH.68.4.394 |pmc=1653950 |pmid=645987}} Many other professional fields have some level of peer review process: accounting,{{cite web |title=AICPA Peer Review Program Manual |url=http://www.aicpa.org/INTERESTAREAS/PEERREVIEW/RESOURCES/PEERREVIEWPROGRAMMANUAL/Pages/default.aspx |url-status=live |archive-url=https://web.archive.org/web/20121028064419/http://www.aicpa.org/INTERESTAREAS/PEERREVIEW/RESOURCES/PEERREVIEWPROGRAMMANUAL/Pages/default.aspx |archive-date=28 October 2012 |access-date=4 September 2012 |publisher=American Institute of CPAs}} law,{{cite web |date = 12 July 2007|url=http://www.legalservices.gov.uk/civil/how/mq_peerreview.asp |title=Peer Review |publisher=UK Legal Services Commission |archive-url = https://web.archive.org/web/20101014002648/http://www.legalservices.gov.uk/civil/how/mq_peerreview.asp |archive-date = 14 October 2010}}{{cite web |url=https://www.martindale.com/ratings-and-reviews/ |title=Martindale-Hubbell Attorney Reviews and Ratings |publisher=Martindale |access-date=27 January 2020 |archive-date=18 January 2020 |archive-url=https://web.archive.org/web/20200118090946/https://www.martindale.com/ratings-and-reviews/ |url-status=live }} engineering (e.g., software peer review, technical peer review), aviation, and even forest fire management.{{cite web |url=http://www.fs.fed.us/fire/doctrine/mgmt/briefing_papers/peer_review_panels.pdf |title=Peer Review Panels – Purpose and Process |publisher=USDA Forest Service |date=6 February 2006 |access-date=4 October 2010 |archive-date=5 June 2011 |archive-url=https://web.archive.org/web/20110605073415/http://www.fs.fed.us/fire/doctrine/mgmt/briefing_papers/peer_review_panels.pdf |url-status=live }}

Peer review is used in education to achieve certain learning objectives, particularly as a tool to reach higher order processes in the affective and cognitive domains as defined by Bloom's taxonomy. This may take a variety of forms, including closely mimicking the scholarly peer review processes used in science and medicine.{{cite journal |last=Sims |first=Gerald K. |year=1989 |quote=The review process was double-blind to provide anonymity for both authors and reviewers, but was otherwise handled in a fashion similar to that used by scientific journals |title=Student Peer Review in the Classroom: A Teaching and Grading Tool |url=https://www.agronomy.org/files/publications/jnrlse/pdfs/jnr018/018-02-0105.pdf |journal=Journal of Agronomic Education |volume=18 |issue=2 |pages=105–108 |doi=10.2134/jae1989.0105 |access-date=4 September 2012 |archive-date=22 December 2012 |archive-url=https://web.archive.org/web/20121222132610/https://www.agronomy.org/files/publications/jnrlse/pdfs/jnr018/018-02-0105.pdf |url-status=live }}{{cite journal|author1-link=Jianguo Liu |last1=Liu |first1=Jianguo |last2=Thorndike Pysarchik |first2=Dawn |last3=Taylor |first3=William W. |year=2002 |title=Peer Review in the Classroom |url=http://chans-net.org/sites/chans-net.org/files/peer_review.pdf |url-status=live |journal=BioScience |volume=52 |issue=9 |pages=824–829 |doi=10.1641/0006-3568(2002)052[0824:PRITC]2.0.CO;2 |archive-url=https://web.archive.org/web/20121222132525/http://chans-net.org/sites/chans-net.org/files/peer_review.pdf |archive-date=22 December 2012 |access-date=4 September 2012 |doi-access=free}}

Scholarly

{{excerpt|Scholarly peer review}}

Medical

{{main|Clinical peer review}}

Medical peer review may be distinguished in four classifications:{{Cite journal|title=Review by Peers|url=https://www.safetyandquality.gov.au/sites/default/files/migrated/37358-Review-by-Peers1.pdf|journal=A Guide for Professional, Clinical and Administrative Processes|access-date=6 August 2020|archive-date=30 October 2020|archive-url=https://web.archive.org/web/20201030224838/https://www.safetyandquality.gov.au/sites/default/files/migrated/37358-Review-by-Peers1.pdf|url-status=live}}

  1. Clinical peer review is a procedure for assessing a patient's involvement with experiences of care. It is a piece of progressing proficient practice assessment and centered proficient practice assessment—significant supporters of supplier credentialing and privileging.{{Cite journal|last1=Deyo-Svendsen|first1=Mark E.|last2=Phillips|first2=Michael R.|last3=Albright|first3=Jill K.|last4=Schilling|first4=Keith A.|last5=Palmer|first5=Karl B.|date=October–December 2016|title=A Systematic Approach to Clinical Peer Review in a Critical Access Hospital|journal=Quality Management in Healthcare|language=en-US|volume=25|issue=4|pages=213–218|doi=10.1097/QMH.0000000000000113|pmid=27749718|issn=1063-8628|pmc=5054974}}
  2. Peer evaluation of clinical teaching skills for both physicians and nurses.{{Cite web|url=http://medschool.ucsf.edu/academy/pdfs/Clinical-Peer-Review-Literature-Excerpts.pdf|archive-url=https://web.archive.org/web/20100814052748/http://medschool.ucsf.edu/academy/pdfs/Clinical-Peer-Review-Literature-Excerpts.pdf |title=Medschool.ucsf.edu|archive-date=14 August 2010}}{{cite journal|vauthors=Ludwick R, Dieckman BC, Herdtner S, Dugan M, Roche M|title=Documenting the scholarship of clinical teaching through peer review|journal= Nurse Educator|volume=23 |issue=6 |pages=17–20 |date=November–December 1998|doi=10.1097/00006223-199811000-00008|pmid=9934106}}
  3. Scientific peer review of journal articles.
  4. A secondary round of peer review for the clinical value of articles concurrently published in medical journals.{{cite journal|vauthors=Haynes RB, Cotoi C, Holland J |title=Second-order peer review of the medical literature for clinical practitioners|journal= JAMA |volume=295 |issue=15 |pages=1801–8 |year=2006|doi=10.1001/jama.295.15.1801 |doi-access=free |pmid=16622142|s2cid=42567486 |s2cid-access=free |display-authors=etal }}

Additionally, "medical peer review" has been used by the American Medical Association to refer not only to the process of improving quality and safety in health care organizations, but also to the process of rating clinical behavior or compliance with professional society membership standards.{{cite book|url=http://www.ama-assn.org/ama1/pub/upload/mm/21/omss-bylaws-4thedition-final.pdf|title=Physician's Guide to Medical Staff Organization Bylaws|page= 131|first=Elizabeth A. |last =Snelson|date=2010|publisher=American Medical Association |archive-url =https://web.archive.org/web/20110806223838/http://www.ama-assn.org/ama1/pub/upload/mm/21/omss-bylaws-4thedition-final.pdf |archive-date = 6 August 2011}}{{cite web|title = Medical Peer Review|url = http://www.ama-assn.org/ama/pub/physician-resources/legal-topics/medical-peer-review.shtml |website =American Medical Association|archive-url=https://web.archive.org/web/20100306064610/http://www.ama-assn.org/ama/pub/physician-resources/legal-topics/medical-peer-review.shtml |archive-date=6 March 2010 }} The clinical network believes it to be the most ideal method of guaranteeing that distributed exploration is dependable and that any clinical medicines that it advocates are protected and viable for individuals. Thus, the terminology has poor standardization and specificity, particularly as a database search term.{{Cite web|date=29 March 2019|title=Peer review: What is it and why do we do it?|url=https://www.medicalnewstoday.com/articles/281528|access-date=2020-08-06|website=Medical News Today |first1=Adam |last1=Felman |language=en|archive-date=28 August 2020|archive-url=https://web.archive.org/web/20200828151726/https://www.medicalnewstoday.com/articles/281528|url-status=live}}

Technical

{{Main|Technical peer review}}

In engineering, technical peer review is a type of engineering review. Technical peer reviews are a well-defined review process for finding and fixing defects, conducted by a team of peers with assigned roles. Technical peer reviews are carried out by peers representing areas of life cycle affected by material being reviewed (usually limited to 6 or fewer people). Technical peer reviews are held within development phases, between milestone reviews, on completed products or completed portions of products.{{cite book| title=NASA Systems Engineering Handbook| id=SP-610S| date=December 2007 | publisher=NASA| url=https://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20080008301_2008008500.pdf| access-date=19 July 2019| archive-date=19 October 2013| archive-url=https://web.archive.org/web/20131019044934/http://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20080008301_2008008500.pdf| url-status=dead }}

Government policy

{{Further|U.S. Government peer review policies}}

The European Union has been using peer review in the "Open Method of Co-ordination" of policies in the fields of active labour market policy since 1999.{{cite web|url=http://ec.europa.eu/social/mlp|title=Mutual Learning Programme – Employment, Social Affairs & Inclusion |website=European Commission |url-status=live |archive-url=https://web.archive.org/web/20230328091511/https://ec.europa.eu/social/main.jsp?catId=1047 |archive-date= Mar 28, 2023 }} In 2004, a program of peer reviews started in social inclusion.{{cite web|url=http://www.peer-review-social-inclusion.eu|title= Peer Review in Social Protection and Social Inclusion and Assessment in Social Inclusion |website= peer-review-social-inclusion.eu|access-date=30 September 2021|archive-date=Jul 18, 2012 |archive-url=https://web.archive.org/web/20120718145342/http://www.peer-review-social-inclusion.eu/ |url-status=usurped }} Each program sponsors about eight peer review meetings in each year, in which a "host country" lays a given policy or initiative open to examination by half a dozen other countries and the relevant European-level NGOs. These usually meet over two days and include visits to local sites where the policy can be seen in operation. The meeting is preceded by the compilation of an expert report on which participating "peer countries" submit comments. The results are published on the web.{{cn|date=February 2025}}

The United Nations Economic Commission for Europe, through UNECE Environmental Performance Reviews, uses peer review, referred to as "peer learning", to evaluate progress made by its member countries in improving their environmental policies.{{cn|date=February 2025}}

The State of California is the only U.S. state to mandate scientific peer review. In 1997, the Governor of California signed into law Senate Bill 1320 (Sher), Chapter 295, statutes of 1997, which mandates that, before any CalEPA Board, Department, or Office adopts a final version of a rule-making, the scientific findings, conclusions, and assumptions on which the proposed rule are based must be submitted for independent external scientific peer review. This requirement is incorporated into the California Health and Safety Code Section 57004.{{Cite web|url=https://ceparev.berkeley.edu/what-is-peer-review/|title=What is Scientific Peer Review?|website=ceparev.berkeley.edu|language=en-US|access-date=2017-03-30|archive-date=30 March 2017|archive-url=https://web.archive.org/web/20170330180350/https://ceparev.berkeley.edu/what-is-peer-review/|url-status=live}}

Pedagogical

{{main article|Peer feedback}}

Peer review, or student peer assessment, is the method by which editors and writers work together in hopes of helping the author establish and further flesh out and develop their own writing.{{cite journal | jstor=26821317 | title=A Study of the Practices and Responsibilities of Scholarly Peer Review in Rhetoric and Composition | last1=Söderlund | first1=Lars | last2=Wells | first2=Jaclyn | journal=College Composition and Communication | year=2019 | volume=71 | issue=1 | pages=117–144 | doi=10.58680/ccc201930297 | s2cid=219259301 }} Peer review is widely used in secondary and post-secondary education as part of the writing process. This collaborative learning tool involves groups of students reviewing each other's work and providing feedback and suggestions for revision.{{Cite journal|last1=Søndergaard|first1=Harald|last2=Mulder|first2=Raoul A.|date=2012|title=Collaborative learning through formative peer review: pedagogy, programs and potential|url=http://www.tandfonline.com/doi/abs/10.1080/08993408.2012.728041|journal=Computer Science Education|language=en|volume=22|issue=4|pages=343–367|doi=10.1080/08993408.2012.728041|bibcode=2012CSEd...22..343S|s2cid=40784250|issn=0899-3408|access-date=18 August 2021|archive-date=5 May 2021|archive-url=https://web.archive.org/web/20210505123331/https://www.tandfonline.com/doi/abs/10.1080/08993408.2012.728041|url-status=live|url-access=subscription}} Rather than a means of critiquing each other's work, peer review is often framed as a way to build connection between students and help develop writers' identity.{{cite journal |last1=Mundy |first1=Robert |last2=Sugerman |first2=Rachel |title="What Can You Possibly Know About My Experience?": Toward a Practice of Self-Reflection and Multicultural Competence |journal=The Peer Review |date=Fall 2017 |volume=1 |issue=2 |url=https://thepeerreview-iwca.org/issues/braver-spaces/what-can-you-possibly-know-about-my-experience-toward-a-practice-of-self-reflection-and-multicultural-competence/}} While widely used in English and composition classrooms, peer review has gained popularity in other disciplines that require writing as part of the curriculum including the social and natural sciences.{{Cite journal|last=Guilford|first=William H.|date=2001-09-01|title=Teaching peer review and the process of scientific writing|url=https://journals.physiology.org/doi/full/10.1152/advances.2001.25.3.167|journal=Advances in Physiology Education|volume=25|issue=3|pages=167–175|doi=10.1152/advances.2001.25.3.167|pmid=11824193|issn=1043-4046|access-date=18 August 2021|archive-date=18 August 2021|archive-url=https://web.archive.org/web/20210818165622/https://journals.physiology.org/doi/full/10.1152/advances.2001.25.3.167|url-status=live|url-access=subscription}}{{Cite journal|last=Baker|first=Kimberly M.|date=2016-11-01|title=Peer review as a strategy for improving students' writing process|journal=Active Learning in Higher Education|language=en|volume=17|issue=3|pages=179–192|doi=10.1177/1469787416654794|s2cid=49527249|issn=1469-7874}}

Peer review in classrooms helps students become more invested in their work, and the classroom environment at large.{{cite journal | doi=10.1016/j.jslw.2012.09.005 | title=What role for collaboration in writing and writing feedback | year=2012 | last1=Wigglesworth | first1=Gillian | last2=Storch | first2=Neomy | journal=Journal of Second Language Writing | volume=21 | issue=4 | pages=364–374 }} Understanding how their work is read by a diverse readership before it is graded by the teacher may also help students clarify ideas and understand how to persuasively reach different audience members via their writing. It also gives students professional experience that they might draw on later when asked to review the work of a colleague prior to publication.{{Cite web|title=Benefits of Peer Review|url=https://www.southwestern.edu/offices/writing/faculty-resources-for-writing-instruction/peer-review/benefits-of-peer-review/|access-date=2021-08-19|website=www.southwestern.edu|language=en|archive-date=19 August 2021|archive-url=https://web.archive.org/web/20210819140738/https://www.southwestern.edu/offices/writing/faculty-resources-for-writing-instruction/peer-review/benefits-of-peer-review/|url-status=live}}{{cite conference |last1=Kern |first1=Vinícius M. |last2=Possamai |first2=Osmar |last3=Selig |first3=Paulo M. |last4=Pacheco |first4=Roberto C. dos S. |last5=de Souza |first5=Gilberto C. |last6=Rautenberg |first6=Sandro |last7=Lemos |first7=Renata T. da S. |editor1-last=Tatnall |editor1-first=A. |editor2-last=Jones |editor2-first=A. |date=2009 |pages=388–397 |title=Growing a peer review culture among graduate students |book-title=Education and Technology for a Better World |doi=10.1007/978-3-642-03115-1_41 |doi-access=free |isbn=978-3-642-03114-4|hdl=10536/DRO/DU:30082218 |hdl-access=free }} The process can also bolster the confidence of students on both sides of the process. It has been found that students are more positive than negative when reviewing their classmates' writing.{{Cite journal |author=Anna Wärnsby |author2=Asko Kauppinen |author3=Laura Aull |author4=Djuddah Leijen |author5=Joe Moxley |date=2018 |title=Affective Language in Student Peer Reviews: Exploring Data from Three Institutional Contexts |journal=Journal of Academic Writing |volume=8 |issue=1 |pages=28–53|doi=10.18552/joaw.v8i1.429 |doi-access=free |language=en-US|hdl=2043/26718 |hdl-access=free }} Peer review can help students not get discouraged but rather feel determined to improve their writing.

Critics of peer review in classrooms say that it can be ineffective due to students' lack of practice giving constructive criticism, or lack of expertise in the writing craft at large.{{Cite web|title=What Are the Disadvantages of Student Peer Review? {{!}} Synonym|url=https://classroom.synonym.com/disadvantages-student-peer-review-10913.html|access-date=2021-08-20|website=classroom.synonym.com|language=en|archive-date=30 September 2021|archive-url=https://web.archive.org/web/20210930055624/https://classroom.synonym.com/disadvantages-student-peer-review-10913.html|url-status=live}} Peer review can be problematic for developmental writers, particularly if students view their writing as inferior to others in the class as they may be unwilling to offer suggestions or ask other writers for help. Gere, Anne Ruggles; Silver, Naomi, eds. (2019). Developing Writers in Higher Education: A Longitudinal Study. University of Michigan Press. ISBN 978-0-472-13124-2. Peer review can impact a student's opinion of themselves as well as others as sometimes students feel a personal connection to the work they have produced, which can also make them feel reluctant to receive or offer criticism. Teachers using peer review as an assignment can lead to rushed-through feedback by peers, using incorrect praise or criticism, thus not allowing the writer or the editor to get much out of the activity. As a response to these concerns, instructors may provide examples, model peer review with the class, or focus on specific areas of feedback during the peer review process.{{Cite web|title=Conducting Peer Review – Writers Workshop|url=https://writersworkshop.illinois.edu/resources-2/instructor-resources/conducting-peer-review/|access-date=2021-08-20|language=en-US|archive-date=20 August 2021|archive-url=https://web.archive.org/web/20210820153927/https://writersworkshop.illinois.edu/resources-2/instructor-resources/conducting-peer-review/|url-status=live}} Instructors may also experiment with in-class peer review vs. peer review as homework, or peer review using technologies afforded by learning management systems online. Students that are older can give better feedback to their peers, getting more out of peer review, but it is still a method used in classrooms to help students young and old learn how to revise. With evolving and changing technology, peer review will develop as well. New tools could help alter the process of peer review.{{Cite journal |last1=Reese |first1=Ashley |last2=Rachamalla |first2=Rajeev |last3=Rudniy |first3=Alex |last4=Aull |first4=Laura |last5=Eubanks |first5=David |date=2018 |title=Contemporary Peer Review: Construct Modeling, Measurement Foundations, and the Future of Digital Learning |journal=The Journal of Writing Analytics |volume=2 |pages=96–137 |url=https://wac.colostate.edu/docs/jwa/vol2/reese.pdf |doi=10.37514/JWA-J.2018.2.1.05}}

Peer seminar

Peer seminar is a method that involves a speaker that presents ideas to an audience that also acts as a "contest". To further elaborate, there are multiple speakers that are called out one at a time and given an amount of time to present the topic that they have researched. Each speaker may or may not talk about the same topic but each speaker has something to gain or lose which can foster a competitive atmosphere.{{cite journal | doi=10.1016/S1475-1585(03)00043-2 | title=The peer seminar, a spoken research process genre | year=2004 | last1=Aguilar | first1=Marta | journal=Journal of English for Academic Purposes | volume=3 | pages=55–72 }} This approach allows speakers to present in a more personal tone while trying to appeal to the audience while explaining their topic.

Peer seminars may be somewhat similar to what conference speakers do, however, there is more time to present their points, and speakers can be interrupted by audience members to provide questions and feedback upon the topic or how well the speaker did in presenting their topic.

Peer review in writing

Professional peer review focuses on the performance of professionals, with a view to improving quality, upholding standards, or providing certification. Peer review in writing is a pivotal component among various peer review mechanisms, often spearheaded by educators and involving student participation, particularly in academic settings. It constitutes a fundamental process in academic and professional writing, serving as a systematic means to ensure the quality, effectiveness, and credibility of scholarly work. However, despite its widespread use, it is one of the most scattered, inconsistent, and ambiguous practices associated with writing instruction.{{cite journal |last1=Armstrong |first1=Sonya L. |last2=Paulson |first2=Eric J. |title=Whither 'Peer Review'?: Terminology Matters for the Writing Classroom |journal=Teaching English in the Two-Year College |date=1 May 2008 |volume=35 |issue=4 |pages=398–407 |id={{ProQuest|220963655}} |doi=10.58680/tetyc20086557 }} Many scholars question its effectiveness and specific methodologies. Critics of peer review in classrooms express concerns about its ineffectiveness due to students' lack of practice in giving constructive criticism or their limited expertise in the writing craft overall.

Critiques of peer review

{{See also|Scholarly peer review#Criticism}}

Academic peer review has faced considerable criticism, with many studies highlighting inherent issues in the peer review process.

A particular concern in peer review is "role duality" as people are in parallel in the role of being an evaluator and being evaluated.{{Cite journal |last=Klapper |first=Helge |last2=Piezunka |first2=Henning |last3=Dahlander |first3=Linus |date=July 2024 |title=Peer Evaluations: Evaluating and Being Evaluated |url=https://pubsonline.informs.org/doi/10.1287/orsc.2021.15302 |journal=Organization Science |volume=35 |issue=4 |pages=1363–1387 |doi=10.1287/orsc.2021.15302 |issn=1047-7039|url-access=subscription }} Research illustrates that taken on both roles in parallel biases people in their role as evaluators as they engage in strategic actions to increase the chance of being evaluated positively themselves.

The editorial peer review process has been found to be strongly biased against 'negative studies,' i.e. studies that do not work. This then biases the information base of medicine. Journals become biased against negative studies when values come into play. "Who wants to read something that doesn't work?" asks Richard Smith in the Journal of the Royal Society of Medicine. "That's boring." Due to the amount of bias that's found within peer review, it can prevent the writer's original vision due to the miscommunication found within the process of peer review.{{Cite journal |last=Bradley |first=Linda |date=2014-12-01 |title=Peer-reviewing in an intercultural wiki environment - student interaction and reflections |url=https://www.sciencedirect.com/science/article/pii/S8755461514000644 |journal=Computers and Composition |volume=34 |pages=80–95 |doi=10.1016/j.compcom.2014.09.008 |issn=8755-4615}} Journals such as the College Composition and Communication tend to experience problems when peer reviewing due to the diverse nature found within the writers of the journal, as well as the varying degrees of bias leading to conflicts between other reviewers.{{Cite journal |last=Berkenkotter |first=Carol |date=1995 |title=The Power and the Perils of Peer Review |url=https://www.jstor.org/stable/465828 |journal=Rhetoric Review |volume=13 |issue=2 |pages=245–248 |issn=0735-0198}} Teachers as well have expressed disdain in peer review, with plenty of them claiming it to waste time in class and unimportant if students already know what they're going to get for their assignment.{{Cite web |title=Volume 35 Number 2 {{!}} Composition Studies |url=http://www.compositionstudies.tcu.edu/archives/352.html |archive-url=http://web.archive.org/web/20100629210334/http://www.compositionstudies.tcu.edu/archives/352.html |archive-date=2010-06-29 |access-date=2025-06-03 |website=www.compositionstudies.tcu.edu}}

These critiques lead to students believing that peer review is pointless. This is also particularly evident in university classrooms, where the most common source of writing feedback during student years often comes from teachers, whose comments are often highly valued. Students may become influenced to provide research in line with the professor's viewpoints, because of the teacher's position of high authority. The effectiveness of feedback largely stems from its high authority. Benjamin Keating, in his article "A Good Development Thing: A Longitudinal Analysis of Peer Review and Authority in Undergraduate Writing," conducted a longitudinal study comparing two groups of students (one majoring in writing and one not) to explore students' perceptions of authority. This research, involving extensive analysis of student texts, concludes that students majoring in non-writing fields tend to undervalue mandatory peer review in class, while those majoring in writing value classmates' comments more. This reflects that peer review feedback has a certain threshold, and effective peer review requires a certain level of expertise. For non-professional writers, peer review feedback may be overlooked, thereby affecting its effectiveness.{{Citation |last=Keating |first=Benjamin |title='A Good Development Thing': A Longitudinal Analysis of Peer Review and Authority in Undergraduate Writing |date=2019 |work=Developing Writers in Higher Education |pages=56–80 |editor-last=Gere |editor-first=Anne Ruggles |jstor=j.ctvdjrpt3.7 |series=A Longitudinal Study |publisher=University of Michigan Press |isbn=978-0-472-13124-2}}

Elizabeth Ellis Miller, Cameron Mozafari, Justin Lohr and Jessica Enoch state, "While peer review is an integral part of writing classrooms, students often struggle to effectively engage in it." The authors illustrate some reasons for the inefficiency of peer review based on research conducted during peer review sessions in university classrooms:

  1. Lack of Training: Students and even some faculty members may not have received sufficient training to provide constructive feedback. Without proper guidance on what to look for and how to provide helpful comments, peer reviewers may find it challenging to offer meaningful insights.
  2. Limited Engagement: Students may participate in peer review sessions with minimal enthusiasm or involvement, viewing them as obligatory tasks rather than valuable learning opportunities. This lack of investment can result in superficial feedback that fails to address underlying issues in the writing.
  3. Time Constraints: Instructors often allocate limited time for peer review activities during class sessions, which may not be adequate for thorough reviews of peers' work. Consequently, feedback may be rushed or superficial, lacking the depth required for meaningful improvement.

This research demonstrates that besides issues related to expertise, numerous objective factors contribute to students' poor performance in peer review sessions, resulting in feedback from peer reviewers that may not effectively assist authors. Additionally, this study highlights the influence of emotions in peer review sessions, suggesting that both peer reviewers and authors cannot completely eliminate emotions when providing and receiving feedback. This can lead to peer reviewers and authors approaching the feedback with either positive or negative attitudes towards the text, resulting in selective or biased feedback and review, further impacting their ability to objectively evaluate the article. It implies that subjective emotions may also affect the effectiveness of peer review feedback.{{cite journal |last1=Miller |first1=Elizabeth Ellis |last2=Mozafari |first2=Cameron |last3=Lohr |first3=Justin |last4=Enoch |first4=Jessica |title=Thinking about Feeling: The Roles of Emotion in Reflective Writing |journal=College Composition and Communication |date=February 2023 |volume=74 |issue=3 |pages=485–521 |id={{ProQuest|2802085546}} |doi=10.58680/ccc202332364 }}

Pamela Bedore and Brian O'Sullivan also hold a skeptical view of peer review in most writing contexts. The authors conclude, based on comparing different forms of peer review after systematic training at two universities, that "the crux is that peer review is not just about improving writing but about helping authors achieve their writing vision." Feedback from the majority of non-professional writers during peer review sessions often tends to be superficial, such as simple grammar corrections and questions. This precisely reflects the implication in the conclusion that the focus is only on improving writing skills. Meaningful peer review involves understanding the author's writing intent, posing valuable questions and perspectives, and guiding the author to achieve their writing goals.{{Cite web|url=https://wac.colostate.edu/docs/wln/v35/35.9-10.pdf|title=Writing centers go to class: Peer review (of our) workshops}}

Alternatives

Various alternatives to peer review have been suggested (such as, in the context of science funding, funding-by-lottery).{{Cite journal |last=Bedessem |first=Baptiste |date=2020-04-01 |title=Should we fund research randomly? An epistemological criticism of the lottery model as an alternative to peer review for the funding of science |url=https://academic.oup.com/rev/article-abstract/29/2/150/5678703 |journal=Research Evaluation |volume=29 |issue=2 |pages=150–157 |doi=10.1093/reseval/rvz034 |issn=0958-2029}}

Comparison and improvement

Magda Tigchelaar compares peer review with self-assessment through an experiment that divided students into three groups: self-assessment, peer review, and no review. Across four writing projects, she observed changes in each group, with surprising results showing significant improvement only in the self-assessment group. The author's analysis suggests that self-assessment allows individuals to clearly understand the revision goals at each stage, as the author is the most familiar with their writing. Thus, self-checking naturally follows a systematic and planned approach to revision. In contrast, the effectiveness of peer review is often limited due to the lack of structured feedback, characterized by scattered, meaningless summaries and evaluations that fail to meet the author's expectations for revising their work.{{Cite journal |last=Tigchelaar |first=Magda |date=2016-01-01 |title=The Impact of Peer Review on Writing Development in French as a Foreign Language |url=https://scholarsarchive.byu.edu/journalrw/vol2/iss2/2 |journal=Journal of Response to Writing |volume=2 |issue=2 |issn=2575-9809}} Some educators recommend that for any school related assignments, instead of having a student to peer review another student's work for a grade, it can be better for an instructional assistant to peer review instead. Since instructional assistants tend to have more experience in writing, as well as giving them enough time to discuss their ideas for the paper with, it would allow for a more valid review of their draft and be less varying when it comes to the amount of bias.{{Cite journal |last=Bourelle |first=Tiffany |last2=Bourelle |first2=Andrew |last3=Rankins-Robertson |first3=Sherry |date=2015-09-01 |title=Teaching with Instructional Assistants: Enhancing Student Learning in Online Classes |url=https://www.sciencedirect.com/science/article/pii/S8755461515000523 |journal=Computers and Composition |volume=37 |pages=90–103 |doi=10.1016/j.compcom.2015.06.007 |issn=8755-4615}}

Stephanie Conner and Jennifer Gray highlight the value of most students' feedback during peer review. They argue that many peer review sessions fail to meet students' expectations, as students, even as reviewers themselves, feel uncertain about providing constructive feedback due to their lack of confidence in their writing. The authors offer numerous improvement strategies. For instance, the peer review process can be segmented into groups, where students present the papers to be reviewed while other group members take notes and analyze them. Then, the review scope can be expanded to the entire class. This widens the review sources and further enhances the level of professionalism.{{Cite journal |last=Conner |first=Stephanie |last2=Gray |first2=Jennifer |date=2023-04-15 |title=Resisting the Deficit Model: Embedding Writing Center Tutors during Peer Review in Writing-Intensive Courses |url=https://scholarsarchive.byu.edu/journalrw/vol9/iss1/4 |journal=Journal of Response to Writing |volume=9 |issue=1 |issn=2575-9809}}

In order to avoid some of the miscommunication that's usually found within peer review, the student can, for example, ask the peer reader three questions about the paper. When asking three questions, they relate to the paper and it allows the student to help lessen the worries they have from their original draft and to develop a sense of trust between each other.

With evolving technology, peer review is also expected to evolve. New tools have the potential to transform the peer review process. Mimi Li discusses the effectiveness and feedback of an online peer review software used in their freshman writing class. Unlike traditional peer review methods commonly used in classrooms, the online peer review software offers many tools for editing articles and comprehensive guidance. For instance, it lists numerous questions peer reviewers can ask and allows various comments to be added to the selected text. Based on observations over a semester, students showed varying degrees of improvement in their writing skills and grades after using the online peer review software. Additionally, they highly praised the technology of online peer review.{{Cite journal |last=Li |first=Mimi |date=2018-01-01 |title=Online Peer Review Using Turnitin PeerMark |url=https://scholarsarchive.byu.edu/journalrw/vol4/iss2/5 |journal=Journal of Response to Writing |volume=4 |issue=2 |issn=2575-9809}}

See also

References

{{Reflist|30em}}

Further reading

  • Baldwin, Melinda (2018). "Scientific Autonomy, Public Accountability, and the Rise of "Peer Review" in the Cold War United States". Isis. 109 (3): 538–558.
  • {{Cite journal |last1=Lee |first1=Carole J. |last2=Sugimoto |first2=Cassidy R. |author2-link=Cassidy Sugimoto| last3=Zhang |first3=Guo |last4=Cronin |first4=Blaise |date=2013 |title=Bias in peer review |url=https://onlinelibrary.wiley.com/doi/10.1002/asi.22784 |journal=Journal of the American Society for Information Science and Technology |language=en |volume=64 |issue=1 |pages=2–17 |doi=10.1002/asi.22784|url-access=subscription }}
  • {{cite journal |journal=International Urogynecology Journal |volume=31 |publication-date=9 December 2019 |pages=481–483 |title=Peer Review: Single-blind, Double-blind, or All the Way-blind? |first=Toni |last=Bazi |year=2020 |issue=3 |doi=10.1007/s00192-019-04187-2|pmid=31820012 |s2cid=208869313 }}
  • {{cite journal |journal=Proceedings of the National Academy of Sciences of the United States of America |volume=114 |issue=48 |orig-date=Composed October 2017 |publication-date=November 2017 |pages=12708–12713 |editor-first=Susan T. |editor-last=Fiske |editor-link=Susan T. Fiske |title=Reviewer Bias in Single- Versus Double-blind Peer Review |first1=Andrew |last1=Tomkins |first2=Min |last2=Zhang |first3=William D. |last3=Heavlin |year=2017 |doi=10.1073/pnas.1707323114|pmid=29138317 |pmc=5715744 |bibcode=2017PNAS..11412708T |doi-access=free }}
  • {{cite journal |journal=Current Sociology |volume=64 |issue=5 |year=2016 |pages=691–698 |title=How Double-blind Peer Review Works and What It Takes To Be A Good Referee |first=Eloisa |last=Martín |doi=10.1177/0011392116656711 |doi-access=free }}
  • {{cite book |last1=Hames |first1=Irene |title=Peer Review and Manuscript Management in Scientific Journals: Guidelines for Good Practice |date=2007 |publisher=Blackwell Publishing |location=Oxford, UK |isbn=978-1-4051-3159-9}}