Would Online Open Review Lead to an Academic Popularity Contest?

Double blind peer-review in science and other fields has been the norm for decades. Now some scholars, as featured at the NY Times this week, are arguing that peer-review needs to move online, eliciting unblinded judgments from a greater number and diversity of experts. But would removing the anonymity of peer-review and widening the scope of participation play into the hands of several common human biases?

Following the New York Times story, I discussed the advantages of open-review and open-access publishing, noting though some of the challenges in moving academic fields and universities in this direction.  In reaction, my colleague at American University Wendy Melillo Farrill offered several important insights, referencing in part the arguments made in Nicholas Carr's The Shallows: What the Internet is Doing to Our Brains. I asked Wendy to share her insights with readers in a guest post.--Matthew Nisbet

I would like to add one more piece to Matt's suggestion about peer review in the digital age. I just finished reading Nicholas Carr's The Shallows: What the Internet is Doing to Our Brains.

At the end of the book, Carr refers to a study by James Evans, a sociologist at the University of Chicago. Evans analyzed 34 million scholarly articles published in academic journals from 1945 through 2005. He looked at the citations in the articles to determine if there were changes in the patterns of citation and research since academic journals shifted from being published in print to being published online.

The assumption was that that making journals available on the Web would "significantly broaden the scope of scholarly research, leading to a much more diverse set of citations," as Carr put it in his book. But that's not what happened in the study Evans did.

Since journals moved online, scholars cited fewer journals than they had previously. Scholars also cited more recent articles with increasing frequency. The broadening of information led to a "narrowing of science and scholarship," Evans found. When Evans discussed his findings in a 2008 article in Science, he explained his counter-intuitive results by suggesting that search engines, which emphasize popular search findings, quickly establish and reinforce a consensus about what information is important and what isn't. The ease of clicking on hyperlinks leads online researchers to "bypass many of the marginally related articles that print researchers" would routinely skim as they browsed through journal articles and books in a library.

One question that should be addressed in this discussion about the movement described in The Times article should be: Would establishing an online, more open peer review system mimic some of the patterns Evans found? Would the most popular academic submissions get the most votes from the reviewers simply because they were popular? Does all of this actually lead to more narrow scholarship or to better scholarship?

--Wendy Melillo Farrill



'Upstreamism': Your zip code affects your health as much as genetics

Upstreamism advocate Rishi Manchanda calls us to understand health not as a "personal responsibility" but a "common good."

Sponsored by Northwell Health
  • Upstreamism tasks health care professionals to combat unhealthy social and cultural influences that exist outside — or upstream — of medical facilities.
  • Patients from low-income neighborhoods are most at risk of negative health impacts.
  • Thankfully, health care professionals are not alone. Upstreamism is increasingly part of our cultural consciousness.
Keep reading Show less

Meet the Bajau sea nomads — they can reportedly hold their breath for 13 minutes

The Bajau people's nomadic lifestyle has given them remarkable adaptions, enabling them to stay underwater for unbelievable periods of time. Their lifestyle, however, is quickly disappearing.

Wikimedia Commons
Culture & Religion
  • The Bajau people travel in small flotillas throughout the Phillipines, Malaysia, and Indonesia, hunting fish underwater for food.
  • Over the years, practicing this lifestyle has given the Bajau unique adaptations to swimming underwater. Many find it straightforward to dive up to 13 minutes 200 feet below the surface of the ocean.
  • Unfortunately, many disparate factors are erasing the traditional Bajau way of life.
Keep reading Show less

After death, you’re aware that you’ve died, say scientists

Some evidence attributes a certain neurological phenomenon to a near death experience.

Credit: Petr Kratochvil. PublicDomainPictures.net.
Surprising Science

Time of death is considered when a person has gone into cardiac arrest. This is the cessation of the electrical impulse that drive the heartbeat. As a result, the heart locks up. The moment the heart stops is considered time of death. But does death overtake our mind immediately afterward or does it slowly creep in?

Keep reading Show less

Cornell scientists engineer artificial material that has three key traits of life

An innovation may lead to lifelike self-reproducing and evolving machines.

Shogo Hamada/Cornell University
Surprising Science
  • Scientists at Cornell University devise a material with 3 key traits of life.
  • The goal for the researchers is not to create life but lifelike machines.
  • The researchers were able to program metabolism into the material's DNA.
Keep reading Show less