Post-publication critique at top-ranked journals across scientific disciplines: a cross-sectional assessment of policies and practice release_nt4feambdrfedjpuetpcr4cz4u

by Tom E Hardwicke, Robert Thibault, Jessica Kosie, Loukia Tzavella, Theiss Bendixen, Sarah A. Handcock, Vivian E. Köneke, John Ioannidis

Published in Royal Society Open Science by The Royal Society.

2022   Volume 9, Issue 8, p220139


Journals exert considerable control over letters, commentaries and online comments that criticize prior research (post-publication critique). We assessed policies (Study One) and practice (Study Two) related to post-publication critique at 15 top-ranked journals in each of 22 scientific disciplines ( <jats:italic>N</jats:italic> = 330 journals). Two-hundred and seven (63%) journals accepted post-publication critique and often imposed limits on length (median 1000, interquartile range (IQR) 500–1200 words) and time-to-submit (median 12, IQR 4–26 weeks). The most restrictive limits were 175 words and two weeks; some policies imposed no limits. Of 2066 randomly sampled research articles published in 2018 by journals accepting post-publication critique, 39 (1.9%, 95% confidence interval [1.4, 2.6]) were linked to at least one post-publication critique (there were 58 post-publication critiques in total). Of the 58 post-publication critiques, 44 received an author reply, of which 41 asserted that original conclusions were unchanged. Clinical Medicine had the most active culture of post-publication critique: all journals accepted post-publication critique and published the most post-publication critique overall, but also imposed the strictest limits on length (median 400, IQR 400–550 words) and time-to-submit (median 4, IQR 4–6 weeks). Our findings suggest that top-ranked academic journals often pose serious barriers to the cultivation, documentation and dissemination of post-publication critique.
In application/xml+jats format

Archived Content

There are no accessible files associated with this release. You could check other releases for this work for an accessible version.

"Dark" Preservation Only
Save Paper Now!

Know of a fulltext copy of on the public web? Submit a URL and we will archive it

Type  article-journal
Stage   published
Date   2022-08-24
Language   en ?
DOI  10.1098/rsos.220139
PubMed  36039285
PMC  PMC9399707
Container Metadata
Open Access Publication
In Keepers Registry
ISSN-L:  2054-5703
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: a2c77bbb-0673-43b5-92b5-7769587e7a04