The 5 Stars of Online Journal Articles

David Shotton, another participant in last summer's Dagstuhl workshop on Future of Research Communications, has an important article in D-Lib entitledThe Five Stars of Online Journal Articles — a Framework for Article Evaluation. By analogy with Tim Berners-Lee's Five Stars of Linked Open Data, David suggests assessing online articles against five criteria:

• peer review
• open access
• enriched content
• available datasets
• machine-readable metadata

For each criterion, he provides a five-point scale. For example, the open access scale goes from 0 for no open access to 4 for Creative Commons licensing. The full article is well worth a read, especially for David's careful explanation of the impacts of each point on the scale of each criterion on the usefulness of the content.

The article concludes by applying the evaluation to a number of articles (including itself). In this spirit, here is my evaluation of our SOSP '03 paper:

• peer review: 2 - Responsive peer review
• open access: 1 - Self-archiving green/gratis open access
• enriched content: 1 - Active Web links
• available datasets: 1 - Supplementary information files available
• machine-readable metadata: 1- Structural markup available