A prospective study on an innovative online forum for peer reviewing of surgical science

Research output: Contribution to journalArticle

Abstract

Background Peer review is important to the scientific process. However, the present system has been criticised and accused of bias, lack of transparency, failure to detect significant breakthrough and error. At the British Journal of Surgery (BJS), after surveying authors' and reviewers' opinions on peer review, we piloted an open online forum with the aim of improving the peer review process. Methods In December 2014, a web-based survey assessing attitudes towards open online review was sent to reviewers with a BJS account in Scholar One. From April to June 2015, authors were invited to allow their manuscripts to undergo online peer review in addition to the standard peer review process. The quality of each review was evaluated by editors and editorial assistants using a validated instrument based on a Likert scale. Results The survey was sent to 6635 reviewers. In all, 1454 (21.9%) responded. Support for online peer review was strong, with only 10% stating that they would not subject their manuscripts to online peer review. The most prevalent concern was about intellectual property, being highlighted in 118 of 284 comments (41.5%). Out of 265 eligible manuscripts, 110 were included in the online peer review trial. Around 7000 potential reviewers were invited to review each manuscript. In all, 44 of 110 manuscripts (40%) received 100 reviews from 59 reviewers, alongside 115 conventional reviews. The quality of the open forum reviews was lower than for conventional reviews (2.13 (± 0.75) versus 2.84 (± 0.71), P<0.001). Conclusion Open online peer review is feasible in this setting, but it attracts few reviews, of lower quality than conventional peer reviews.

Details

Authors
  • Martin Almquist
  • Regula S. Von Allmen
  • Dan Carradice
  • Steven J. Oosterling
  • Kirsty McFarlane
  • Bas Wijnhoven
Organisations
External organisations
  • Skåne University Hospital
  • Erasmus University Medical Center
  • Kantonsspital St Gallen
  • Hull York Medical School
  • Spaarne Gasthuis Hospital
  • John Wiley & Sons, Inc, United Kingdom
Research areas and keywords

Subject classification (UKÄ) – MANDATORY

  • Other Medical Sciences not elsewhere specified
  • Computer and Information Science
Original languageEnglish
Article numbere0179031
JournalPLoS ONE
Volume12
Issue number6
Publication statusPublished - 2017
Publication categoryResearch
Peer-reviewedYes