Sunday, October 16, 2011

Should we review for any old journal?

It's no secret that academic publishers are able to cut expenses by getting free content, free review, and often free editorial expertise from the scientific community. Web hosting, copy editing, and printing costs remain, of course, so publishers cover these expenses by charging for the content - often by charging subscription and article access fees (directly or indirectly) to the very same researchers who provide their expertise for free. When some commercial publishers are generating impressive profits in spite of the bad economy, many researchers are rightfully perturbed. How should we, as a research community, respond?

Mike Taylor, writing at SV-POW! and Times Higher Education, argues that (among other strategies) scientists should refuse to review manuscripts submitted to non-open publications. To his credit, he has put his money where his mouth is (no surprise to those who know how solid Mike's character is). If done by enough people, this will surely have the desired effect of slowing down the cogs of the big non-open access journals (and making open access [OA] a more appealing alternative). But, what is the collateral damage? Is it worth it? Who would even receive the message?

I argue that, unless carefully constructed, such reviewing boycotts may never be noticed by some of the concerned parties. A typical journal editor will think "oh, Reviewer 1 refused to review. . .on to Reviewer 2." Even if the refusal to review is accompanied by a note explaining the reasoning behind the refusal, only the editor will ever see it (and potentially the publishing admins - who have little vested interest in changing the status quo).

Second, when the pool of qualified reviewers is small to begin with, this could have the consequence of letting some really bad stuff slip into publication. I've reviewed enough papers and read enough literature to know that unless I flag some manuscripts, nobody else will. (Richard has a similar sentiment in his comments at SV-POW!). Despite the schadenfreude of seeing non-OA journals become associated with increasingly substandard work, it would also mean that we're left with a mess to clean up (particularly in the case of "new" species). Profits are reported quarterly, but we have to deal with crummy taxonomy forever.

Third, the journals are not the ones hurt most directly by review boycotts; it is the authors. The journal will almost always find someone else to review the paper (with a delay as these reviewers are recruited); and if not, the manuscript will be returned for lack of qualified reviewers (with a delay as the paper is prepared for submission elsewhere). Rightly or wrongly, publications are a primary currency of academia. If getting that publication delayed means my friend or colleague doesn't get a job, or a grant, or tenure, I have hurt them, not just the profits of the journal.

There are some constructive alternatives, fortunately - given a choice, I would say #2 and #3 have the most utility and best balance intended and unintended consequences.

1) Refuse to review the paper, but fully explain why in a letter submitted directly and separately to the editor, journal, and authors. This way everyone gets the message - not just a select few.

2) Review the paper, but include a message with the review (perhaps both in the review text and in a direct letter to the authors) on the shame of the work being locked behind a paywall. Make the authors think twice about whether or not the intended audience will ever see the paper.

3) Submit your own work to open access journals, cite work in open access journals, and encourage your colleagues to do the same.

I sympathize with the sentiment that we academics shouldn't be propping up the questionable practices of some publishers, but we also need to avoid shooting ourselves (and our colleagues) in the foot as a result.

Update: Mike Taylor has posted a response to this post at SV-POW!


Heinrich Mallison said...

I agree that simply refusing to review is not a good option. On the other hand, as part of a package (submit to OA only, cite OA work preferentially, good-mouth OA journal, bad-mouth the others, refuse volunteer work for for-profit) it has its part. After all, it gets a message out, especially if you make sure (as you suggested) that all parties are informed.

Personally, I do not have the luxury to do all these things the way I please. "Publish or perish" involves, sometimes, no choice on where to submit. Also, reviewing something that is right up my alley and has a huge error right up there in the abstract that I know most reviewer's won't catch - well, I can't resist. But over time, as a general trend, using all available measures is going to get us the best long-term result. Let's do it!

Anonymous said...

I have had reviewer's comments removed by editors (or someone) before, but only found out about it because the reviewer identified themselves to me. I think in that case it would be best to follow option #1 to ensure the message makes it to the necessary parties.

Andy said...

Agreed, Heinrich - few of us have the luxury of real freedom to submit wherever we want.