How do you read the literature? Thoughts on academic maturation

How much should you trust the scientific literature? Reflecting on my own academic maturation, as well as observing on-line discussions of dinosaur paleontology for over 15 years (yikes, I'm getting old!), I have concluded that most of us pass through three stages: 1) Credulity; 2) Cynicism; and 3) Maturity.

Credulity
This is inevitably one's first stop on the journey through the scientific literature: accepting everything that's published at face value. Credulity is also paired with the assumption that the most recent publication must be the most conclusive. For instance, let's say Dr. X described a new species in 2001. Dr. Y published a new paper in 2010, saying that the new species is invalid. Dr. Y must be correct, because she had the last word, right?

Another symptom of this stage is fanboy(girl)-ism. Anything published by Dr. Glamour is the bee's knees (it's widely featured in the news media, so it must be true)! Wow, Dr. Glamour published a new theory on the dinosaur extinction - it will revolutionize the science! Any nay-sayers are just jealous, or afraid of change.

I hit this stage during high school and college.

Cynicism
Suddenly, everything comes crashing down. You talk to another paleontologist, who tells you that Dr. Glamour's work isn't actually that highly regarded. Maybe he has a reputation for massaging his data just a little too much, or conveniently omits contradictory evidence in his papers. Then you find out that Dr. Z has just published a paper saying that Dr. X was actually correct in the first place, and Dr. Y's synonymization was a little too hasty. Your obvious conclusion: the scientific literature is untrustworthy. Everything ever written is a steaming pile of unreliable ramblings.

Most people don't go through a full-blown case of cynicism, of course. Usually we just get an incomplete case. Everything written by Dr. Glamour (but only some of the stuff by Dr. Y) is untrustworthy, etc. A related syndrome focuses on the methodology; a paper is considered horrible because it used or didn't use a particular technique.

I hit this stage between the end of my undergrad and the early to middle parts of my graduate career.

Maturity
Most of us reach this stage only after a lengthy amount of time in the field (or the end of our graduate student career). Our BS detectors are honed to an appropriate level, and we accept that many of the papers out there aren't half-bad, and a minor mistake or two isn't enough to relegate research to the dustbin.

For my part, I still occasionally waver between cynicism and maturity; I might cast an exceptionally suspicious eye on research coming from certain researchers or using certain techniques (even if it's not necessarily warranted). Maybe I even have a little credulity at first, if it's a technique or area of science I'm not yet completely familiar with. At the same time, having been around the block a few times as a scientist, I am a little more understanding when it comes to the perceived shortcomings of a paper. As long as the basic science is still good, live and let live. A paper can have a fantastic morphological description, but a pretty weak discussion. With a little practice reading the literature, it's becoming easier and easier to pick up on the high and low points of a publication.

Summing it up
We all relate to the academic literature in different ways, depending on our life experience, scientific goals, and "academic maturity." It's up to us - with the help of trusted friends and colleagues - to continually work to improve our own approaches.