Peer review plays a pivotal role in scientific research and scholarly publishing. However, recent innovations in peer review may not be well known to various constituents of the academic community. More importantly, various elements outside the academe now shape these recent innovations in peer review. Although a fool-proof arrangement is yet to be established, peer review is considered to be the gatekeeper of science on the whole. Sadly, it appears to have moved forward at a turtle pace compared with the rapid progress in research.1 It is still far from being perfect and suffers from bias, lack of transparency, rational cheating, plagiarism, professional jealousy, hidden conflict of interest, fake peer reviewers, and false reports.234 Moreover, the peer review system is overwhelmed by the growing number of complex papers against the stagnant pool of reviewers, delaying peer review.5

Various factors aggravate the delay and quality of peer review. These include requests for multiple revisions and the lack of time for reviewers to read the paper, as well as the shift to digital publishing which drains human and technical resources from the enormous publishing workload.67 To overcome these problems, a more streamlined reviewing process and innovative approaches to peer review have increasingly drawn attention.5 To identify relevant articles on innovative strategies for peer review and reviewer competency, we adhered to the search strategy recommended for narrative reviews by Gasparyan et al.8 We searched through MEDLINE, Embase, and Scopus databases using the following keywords: peer review, peer review innovations, peer review models, open access publishing, publications, education, review bias, peer reviewer, reviewer competency, and reviewer training. This article provides an overview of the innovative strategies for peer review and perspectives to consider when making changes to the peer review process.

Go to :

Peer review can be divided into two broad categories, traditional peer review and open peer review. Traditional peer review consists of in-house assessment by journal editors, evaluation by external peer reviewers chosen by the editor, and final assessment by the chief editor. Articles undergo rigorous internal and external analyses before acceptance. An initial editorial appraisal allows the filtering of low-quality submissions. The review process is confidential and the reviews are not published.910

Open peer review discloses the names of the editors and reviewers handling the paper to the authors. The open identities and reports are thought to increase transparency and temper strong criticism. They may also improve the quality of reviews, avoid redundant reviews, speed up publication, and incentivize reviewers. Open peer review aims to facilitate more participation between reviewers and authors, interactive peer review in the form of digital discussion, and collaborative review of preprints. This platform is basically similar to traditional peer review, but the articles are published online and undergo several open peer reviews as managed by the editor.101112 A comparative summary between traditional peer review and open peer review is shown in Table 1.

Go to :

The current peer review innovations described by Tennant et al.7 include pre-peer review commenting, pre-publication peer review, post-publication peer review, post-publication commenting, collaborative review, portable review, recommendation services review, and decoupled post-publication review. Pre-peer review commenting involves the informal commenting or discussion on a publicly available pre-publication manuscript draft. Pre-publication peer review consists of a formal and editorially invited evaluation of research by selected experts in the relevant field. Post-publication peer review comprises a formal and optionally invited evaluation of research by selected experts in the relevant field after publication. Post-publication commenting consists of an informal discussion of published research independent of any formal peer review. Collaborative review involves manuscript assessment wherein referees, editors, and external readers provide interactive comments leading to a consensus decision and a single set of revisions. Portable review means the authors pay a company (e.g., Rubriq) for a standard single-blind review that they can submit with the paper to collaborating journals. Although this may cut down redundant reviews,13 it can also distract focus on publishing good science and purely intellectual objectives to non-academic objectives (e.g., monetary gains) from peer-reviewing.4 Recommendation services review involves post-publication evaluation and recommendation of significant articles, often through a peer-nominated consortium. Decoupled post-publication review consists of adding notes directly to the highlighted sections of the work. These added notes can be kept private or made public.

Other innovations to peer review include cascading peer review, independent peer review (e.g., Rubriq and Peerage of Science), and interactive peer review. In Cascading peer review, rejections are avoided by redirecting peer-reviewed but rejected papers to a more suitable publication venue.14 The consortia enable papers with the referee reports to move easily between publishers, reducing time and expense of repeated evaluation. Some pass on the peer reviews with the rejected papers.13 Occasionally, reviews from other journals accompanying manuscripts rejected are used for other journals.15 In independent peer review (e.g., Rubriq and Peerage of Science), a number of companies provide pre-submission peer review for a fee (e.g., Rubriq) or a submission supplementary material.1316 Thus, reports from commercial reviewer platforms are used to assist in peer review.17 This involvement of commercial refereeing bodies allows the dissociation of review from the journal publishing the article, thereby facilitating a faster review (e.g., Rubriq, Peerage of Science, Axios Review) or the detection of integrity issues (e.g., Research Square).18 Some companies use an online “scorecard”15 to determine strengths and weaknesses of a paper.19 For Peerage of Science, the fee is paid by the journal which publishes the offering.15 In interactive peer review, the reviewers interact online with the authors and other interested scientists for a more open and collaborative review. Although this is more supportive, it can also prematurely expose a study or challenge experts.20 A comparative assessment of these peer review innovations in relation to open access publishing features is shown in Table 2.

Go to :

Peer review involves different types of blinding. Blinding that is related to the identifiability of reviewers, authors, and editors includes single-blind peer review, double-blind peer review, and triple-blind peer review. Blinding that is related to the type of peer review include blinding in private open peer review, unattributed peer review, optional peer review, pre-publication open peer review, post-publication open peer review, and peer review by endorsement. In single-blind peer review, the authors are known but the reviewers are anonymous. Thus, strong or biased comments are occasionally encountered.79 In double-blind peer review, the reviewers and authors are anonymous.1011 This achieves equality in gender/ethnicity,521 and reduces bias,5 but it may lessen conflicts of interest awareness.9 In triple-blind peer review, the authors and their affiliations are kept hidden from the editor.711 This blinding therefore runs counter to open peer review.11 For blinding in private open peer review, the names of the authors and reviewers are revealed upon their consent. This becomes advantageous as the authors and reviewers can interact freely. For blinding in unattributed peer review, the reports of the reviewers are made public anonymously upon their consent after publication.7 The disadvantage of this blinding is its failure to give credit to the reviewers. For blinding in optional peer review involving single-blind peer review, the reviewers can make their review and name public. This may avoid bias and promotes incentivization of the reviewers.7 For blinding in pre-publication open peer review, the referees are disclosed to the authors before publication. After publication, the peer review history and referees' names are made public.7 This gives credit to the reviewers. For blinding in post-publication open peer review, the referees' names and reports are made public.22 An advantage of this blinding is that critiques from other researchers can be also added.23 For blinding in peer review by endorsement, the reviews are pre-arranged and the article is eventually approved by the reviewers.7 This blinding may be unfair if the studies are of poor quality.

Go to :

The peer review process often takes about 18 months to complete, thus there have been urgent calls for a faster, more open, and less cumbersome review procedure.2124 However, selecting the most suitable reviewers can also take time because of their different interests, abilities, or analytical skills.6 Many reviewers consider reviewing papers for free as a thankless job24 and wittingly or unwittingly incur in delays. Their decision to accept review invitations is usually influenced by the journal prestige and opportunity to network with the editor.25 However, the increasing number of questionable papers discourages them from readily accepting invitations.1 They also decline to review because of lack of time or insufficient expertise in the field.26

Peer review delays inevitably occur when reviewers are burned out from uncompensated over-reviewing21 or when they are imposed deadlines.6 Regrettably, some reviewers steal the ideas of competing authors and slow down the review process by requesting unnecessary revisions and additional experiments.3 There is also the wasted time that elapses before an editorial decision can be made or before a paper even gets read by the reviewers.6 Without the benefit of cascading peer review, every submission of a rejected paper means another redundant review which further delays publication, costs time and money, and frustrates the authors.13

Go to :

Over the years, the strategic shift from traditional to open access peer review to sustain the increasing rate of paper submissions has become evident. This development has spurred changes in the review process in terms of shortening the review time, enforcing deadline adherence, providing reviewer incentives, including early career researchers as reviewers, improving editorial management, and opening peer review.27 The idea of standardization of peer review has also been proposed.16 Some of the more radical publishing approaches currently applied involve open peer review in which anonymous reports are made public, publish first and peer review later, and the use of an independent validation service. The newer publishing approaches include complete reliance on a validation step and third-party peer review.28 The future peer review models that have recently been described include the Reddit, Stack Exchange, Amazon, GitHub, Hypothesis, Wikipedia, Blockchain, AI-assisted peer review, and Hybrid peer review models.7 A comparative assessment of these models in relation to open access publishing features is shown in Table 3.

Go to :

Peer review has often been considered a thankless undertaking and in many cases biased.47 Its lack of incentives and insufficiency in improving academic reputation remain as key limitations.29 Thus, various nonfinancial30 and crediting incentives,5 as well as financial incentives7 have been attempted to overcome these and other limitations.

Nonfinancial incentives may come in the forms of frequent reviewer invitations, being up-to-date with research developments, opportunities to influence science, increased acumen in reviewing, free journal access or subscription, access to databases/research platforms and digital libraries, acknowledgment in journal websites, publicized reviews, letter of thanks, certificates of excellence, and editorial board appointment.31 Crediting incentives may be given by formally recognizing the reviewing work and linking peer review activity to ORCID records using DOIs.526

Financial incentives can be received through the Rubriq system by providing pre-publication reviews or from compensation derived from the article processing charge.1530 Although cash incentives can hasten reviews, many journals cannot realistically afford it. Cash incentives may also affect the quality of review, transform the review process into business,30 or damage the moral sentiments of researchers.6 Other forms of financial incentives include waiver of publication charges and free access to paid articles.32

Go to :

Training and adherence to core competencies of reviewers are crucial in producing high-quality reviews. Training is achieved when reviewing author instructions from journals, receiving guidance from academic peers,25 or continuing education on digitization and open access.33 The creation of a common database of potential reviewers (i.e., Global Reviewer Index Directory) that could be shared across a publishing house or within a professional body has been proposed. Unfortunately, this was not realized. However, Publons can be used as a database of potential reviewers. In fact, training and orientation through the Publons Academy can be received to further develop skills in reviewing.34

The Publons Academy helps in training reviewers by verifying and providing recognition of their review activity, which may increase review acceptance, hasten review time, and enhance review quality.2832 Publons plays an important role in opening access to the reviewers' comments by improving the transparency of the review process. Publons accomplishes these by offering the publication of full reviews. This opens the whole pre-publication process as well as the identity of the reviewers post-publication. It also provides a platform for discussing the papers and reviews as part of its training. In fact, the Publons Academy provides a free peer review training course on the core competencies of peer reviewing.35

Additionally, Publons announces the Peer Review Awards for the top 1% of peer reviewers in each field in the peer review week of September. Official certificates are given to the winners to acknowledge their achievements, and badges are awarded on their profiles. The possibility of including the Publons ranking and awards in the resume when applying for academic positions, fellowships, grants, and continuing professional development is one of the important benefits of Publons. All these initiatives train reviewers to produce good quality reviews, avert reviewing inconsistencies, and avoid abuse of the peer review system.34

Core competencies among peer reviewers are based on the recommendations of associations concerned with the integrity of peer review. These associations include the Council of Science Editors (CSE),36 World Association of Medical Editors (WAME),37 International Committee of Medical Journal Editors (ICMJE),38 and Committee on Publication Ethics (COPE).39 The core competencies commonly recommended by these associations may be categorized as reviewer's responsibilities to the authors, editors, and readers. A summary of these core competencies and reviewer's responsibilities is shown in Table 4.

Go to :

Overall, the recent transition from traditional subscription to open access publishing has increased the reviewing and publishing options of authors. Now, authors can opt to publish articles that meet the minimum standard and then rely on post-publication review by the scientific community.26 Authors can also choose journals that use non-selective review. This is a review process wherein reviewers are requested to focus more on the validity of the methods and results of the study. This form of review is also referred to as “impact neutral review” and has been used by a number of open access journals (e.g., PLOS One in 2006 and Frontiers in 2007).740

Broader innovations and strategies have also become available to authors according to discipline. These include open review, interactive review wherein editors, reviewers and authors work together to improve the quality of a paper, and informal out of channel reader commentary.40 Moreover, there are now strategies on introducing paid peer reviews and crediting peer reviewers.25 This moving away from classical peer review to a more open and interactive peer review may well become an important path for research in the medical and nursing sciences similarly to research in the physical and mathematical sciences. However, this path may initially be long and arduous because of the varied medical and nursing disciplines that require different review processes. Progress is anticipated towards a more diversified open and interactive peer review involving adaptable mechanisms that promote high-quality reviews which highlight study novelty and incentivize reviewers.

Unfortunately, reviewer education and training crucial in sustaining long-term peer review innovations have remained insufficient.4 What is currently helpful for training and evaluating reviewers are the core competencies set forth by the CSE, WAME, ICMJE, and COPE.36373839 Moreover, financial incentives have raised legitimate concerns on review fairness and money misappropriation.1 There is a rightful concern that peer review innovations involving financial incentives may cater to those with more financial capability.16 Understandably, this can become unfair or may create a vicious cycle of accepting or rejecting papers simply to maintain journal circulation. There is also the issue of misusing money originally intended for peer review.16

Despite the established core competencies for training and evaluating reviewers, their adherence to the rules of honest and transparent review may also be compromised in some Asian countries where fake peer review appears to concentrate. Manipulation can be in the forms of suggesting fake reviewers whose invented e-mail addresses direct the review invitation to the author, creating a peer circle to internally review a co-participant's paper, or paying a third-party agency to provide fabricated reviews. Such manipulation reportedly occurs more with men and accounts for majority of retractions in open access journals with a low impact factor.41 Consequently, the outcomes of fake peer review are fabricated low-quality publications and retraction.

Regarding peer review transparency, indeed publishing the referees' reports alongside articles and opening authors' and reviewers' identities allow greater participation in open peer review.42 The study is therefore placed in the context of a discussion, aiming at transparency and collaboration.43 Although there is a high level of support for opening peer review, this may not always be true for opening reviewers' identities to authors.44 This is understandable especially in reviews involving no incentives or credits.

What seems to be lacking are studies on improving the competence or selection of reviewers. Currently, there is an increasing trend of requesting authors to suggest peer reviewers, which appears to be beneficial and harmless. However, author-suggested reviewers have been reported to provide reports of comparable quality to non-author-suggested reviewers, although these reports are more likely to recommend acceptance.45 In this context, the call for ceasing the practice of instructing authors to suggest reviewers or for making it optional46 to eliminate bias has validity.

The importance of the reviewing guidance of journals should not be overlooked. Guiding reviewers through the review process or leaving them to decide on the appropriate ways of reviewing has been reported to most effectively detect problematic publications, whereas partly guiding reviewers appeared to be least effective.47 Thus, this aspect should also be scrutinized and improved as it affects the review quality and the ability to detect publication misconduct.

The use of twitter, blogs, and other forms of social media to comment on already published articles has the advantages of transparency and involvement of a wider group of people.48 There is, however, the risk of receiving irrelevant comments from non-specialist reviewers. This promising form of post-publication peer review deserves more study and application.

Another factor that deserves attention is the increasing availability of biomedical pre-print repositories which serve as a publishing mechanism without the need for traditional peer review.40 Although these repositories may provide a primary channel of communicating reports without reviewing delays and biases, these reports have in fact not gone through any formal peer reviews. Thus, these reports are not considered published papers in the usual sense of peer-reviewed publications. Such nullification of the peer-review process may have important consequences on evidenced-based medicine.

Go to :

As with anything new comes important areas that need to be validated. Thus, it is important to determine whether the peer review innovations have been thoroughly tested or not. Specifically, the effects of these innovations on the speed with which articles are published, and on their content and quality need to be confirmed. It is also important to elucidate whether the innovations and incentives have reduced bias against particular categories of authors and have made scientific publishing more accessible. Clarifications of whether the innovations have made it easier to publish replication studies, negative results, and hypotheses that go against mainstream opinion are critical. Overall, it is vital to determine whether the innovations and incentives are more effective than traditional practices in detecting scientific malpractice, improving the quality of accepted papers, and enabling readers to keep abreast with the latest developments in their respective disciplines.

Go to :

The transition from subscription-based to open access publishing has allowed rapid access to research data, global visibility of articles, archiving, and indexing. It has spurred innovations towards open peer review, post-publication peer review, or cascading peer review to credit peer reviewers and address issues of transparency, consistency, cost, and speed. Opening the peer review process makes it more transparent with more filtering opportunities. However, the review quality may be compromised when financial incentives are prioritized. Thus, critical assessments of peer review innovations based on past and presents experiences are indispensable. A theoretical appraisal must be balanced by a realistic appraisal of the ethical roles of all stakeholders in enhancing peer review. At this point, identifying and developing core competencies among reviewers, continuing education of researchers, reviewer education and training, and professional engagement of the scientific community appear to be the best approaches to bridging gaps in an imperfect but indispensable peer review system.

Go to :