Nature Precedings needs to have a good rating system for open, community-based review to work well. Currently, submitted articles can be voted for, but that does not tell one how many would have voted against it. Nor does one get to know the negative points unless they go through the whole article themselves. Such negative points may have been mentioned in some comments but they are not easy to spot. Further, one is usually disinclined to write textual comments unless one has a strong interest to do so.

With open preprint systems, being able to find useful and reliable ideas and data in articles is perhaps more important than being able to submit one. This becomes apparent as the number of articles increase, when searching can return hundreds and thousands of articles. One can’t go through all of them, and a few ‘bad’ articles can easily cause frustration and distrust in the quality of the submissions.

But if search criteria can include objective measures of article quality, then one can indeed easily find valuable material. Nature Precedings should therefore opt for a point-based rating system where different aspects of articles can be appraised.

Thus, instead of just letting one vote for an article, one should be allowed to rate its different aspects on, say, a 1-5 scale. Such aspects can include:

1. clarity
2. originality
3. novelty
4. presence and quality of experimental data
5. logical procession
6. depth
7. proper referencing

In effect, this would be a proper peer-review system.

The ratings, both their average and their spread, should be displayed alongside articles.

A good review/rating system will discourage submission of bad articles, build trust in the usability and reliability of content in Nature Precedings, and encourage quality submissions.

(similar comments posted elsewhere on the web by me)