Showing posts with label impact factor. Show all posts
Showing posts with label impact factor. Show all posts

Thursday, April 26, 2012

A Paleontology-Specific Impact Factor for PLoS ONE

The threads at SV-POW! are hopping right now, particularly with one commenting on open access in Journal of Vertebrate Paleontology. One question that came up is how much, if at all, the impact factor of PLoS ONE (4.411 for 2010) indicates the reach of paleontology papers in that journal. In other words, if PLoS ONE just published paleontology papers, what would its IF be?

Naturally, I had to calculate it out. I used the standard IF formula, and looked just at citations in 2010 for papers published in 2008 and 2009. Citation counts were derived from Web of Science, which is linked to from each individual article at the PLoS ONE website. Articles under consideration from 2008 and 2009 were harvested from the PLoS ONE Paleontology Collection; one or two articles in there were only tangentially paleontological, but I kept them in anyhow just for consistency.

I calculated a "paleontology IF" of 3.317 for 2010 - a little lower than 4.411 for the overall journal but still higher than in other more field-specific publications. So, not too shabby.

This omits the issue of whether or not impact factors are worth anything, but I won't delve into that here. Love it or loathe it, we scientists still like to talk about IF!

Wednesday, September 8, 2010

Return to the Blogosphere

I'm back! Let's just say that a global circumnavigation, two months away from home, and a move in the middle, don't leave a lot of time for blogging. It was a fun and productive summer, but now it's time to settle back in for the fall.

For this re-inaugural post, I wanted to touch on a few highlights from the past few months, particularly in the world of open access and paleo research. I'll cover a variety of topics in more detail in future posts, hopefully.

Big Happenings at PLoS ONE

The online, freely accessible journal PLoS ONE hit a variety of important milestones this summer, including:
  • For the first time, the journal received an official impact factor from Thompson-Reuters. The result: a respectable 4.351. Although this value certainly exceeds that for your typical paleontology journal (e.g., Paleobiology has an IF of 2.985, and JVP has an IF of 2.536), it is more properly compared to other general interest journals. For instance, Naturwissenschaften has an IF of 2.126 and Proceedings B an IF of 4.857. Thus, PLoS ONE is doing pretty well in the whole impact factor "game." Although impact factor has come under a lot of fire lately, we still face the reality that many scientists need to publish in journals that have an IF. Thus, the assignment of an official IF is a big step forward for the journal.
  • PLoS ONE launched a new (and hopefully more user friendly) manuscript submission system. Read all about it here.
  • PLoS launched a new blog network.
  • Full disclosure: I am a section editor at PLoS ONE.
Happenings Around the Blogosphere
  • The venerable ScienceBlogs had a major sea change, with a number of respected bloggers jumping ship. I'm still working on updating my personal blog feeds. But, don't forget that notables such as Tetrapod Zoology remain!
  • WitmerLab launched a great new blog, chock full of goodies from all of the folks there.
  • The spam filters at Blogger are horrible. I'm seriously considering transferring over to WordPress.
Research Happenings
That is all for now.

Thursday, September 17, 2009

Does Anyone Read Our Papers?

Writing papers is fun, but rather pointless unless anyone reads them, uses them, and cites them. How do we find out if anyone reads our work? Gross citation counts are nice, and easily provided by ISI Web of Science (easily, that is, if your institution coughs up the money to pay for the database) or Google Scholar (free, but not always as comprehensive as ISI's counts). These services also provide links to the papers with the citations. This is useful, but everyone knows that more people read the paper than actually cite it. The problem, of course, is that there is no way to know how many are reading the darned thing.

Until now. Public Library of Science (the publishers of PLoS ONE, PLoS Biology, and other open access journals; in the interests of full disclosure, I'm an academic editor for PLoS ONE) has just completely shifted the playing field. Free, article-level metrics are now available. Easily. With one click, you can find out how many page views a research article has had and how many people have downloaded the PDF. Better yet, you can track trends through time and download the data into an Excel spreadsheet for further analysis.

Just for fun, I checked out the stats for my co-authored paper on Triceratops horn use, which was published in January of this year. To date, the publication has had over 7,000 page views, 851 downloads of the PDF file, and 1 citation. The paper on Darwinius, which came out shortly after the Triceratops paper, has had over 66,000 page views and over 5,800 downloads of the PDF file. PLoS ONE also provides summary tables for selected disciplines - a paper on evolutionary biology (which includes paleontology, for most purposes) published in 2008 could expect to have racked up at least 2,200 hits by now.

So what's to like here? Well, an author gets an immediate sense if someone is paying attention to a publication. Page views and PDF downloads are a valuable tool for gauging community interest. In concert with citation data, it's probably a far better gauge of a paper's worth than the impact factor for the journal that the publication happens to show up in. The data are also freely available, transparent, and frequently updated. The latter is particularly important because it may be years before a paper's full impact is known. An open-access metric for an open-access world.

And are there any problems? As with any metric, the unfortunate answer is yes. Page view counts probably include a lot of casual readers, who read the abstract and promptly forget the existence of the article in question. These counts could also be gamed by "click contests" - one need only smell the stench emanating from the hordes of Pharyngula's zombie fanboyz as they lurch towards the next on-line poll to realize just how malleable page view data potentially are (although to PLoS's credit, they have attempted to filter out any robot and web crawler traffic). The metric will also be abused by administrators, who will still make career-ending decisions based on a number (although at least it's a hopefully more relevant number this time). Once again to PLoS's credit, they provide explanatory and cautionary pages candidly outlining the pros and cons of the metric.

I suspect that other journals will follow suit - it may not happen tomorrow, but it will happen. We may be seeing the death of the traditional, sometimes tyrannical, "impact factor." Let's hope we don't replace it with a new despot!