The key articles in previous literature that informed the design of the tool used in this study were as follows:
- Information Quality Discussions in Wikipedia. Stvilia B., Twidale M. B., Gasser L. and Smith C., 2005
- Assessing information Quality of A Community-Based Encyclopaedia. Stvilia B., Twidale M. B., Smith C and Gasser L., 2005
- http://www.mediawiki.org/wiki/Article_feedback/UX_Research
- http://en.wikipedia.org/wiki/Reliability_of_Wikipedia
- Crawford, H. (2001). Encyclopedias. In: R. Bopp, L. C. Smith (Eds.), Reference and information services: an introduction (3 ed.). (pp. 433-459). Englewood, CO: Libraries Unlimited
- Gasser, L., Stvilia, B. (2001). A new framework for information quality. Technical report ISRN UIUCLIS--2001/1+AMAS. Champaign, IL: University of Illinois at Urbana Champaign
- Critical Appraisal Skills Programme (CASP) Making sense of evidence: 10 questions to help you make sense of qualitative research
- http://strategy.wikimedia.org/wiki/Quality/Quality
- Harnessing the Wisdom of Crowds in Wikipedia: Quality Through Coordination. Kittur A., Kraut R. E. Proceedings of the 2008 ACM conference on Computer supported cooperative work
- Measuring article quality in wikipedia: models and evaluation. Hu M., Lim E., Sun A., Lauw H. W. and Vuong B. Proceedings of the sixteenth ACM conference on Conference on information and knowledge management
3.4.2 Standardisation and Anonymisation Protocol
A standardisation and anonymisation protocol was drawn up to ensure that all cues as to the source of the articles were removed. This included the removal of particular formatting patterns such as the article tree at the beginning of Wikipedia articles, special in-text references and internal links and the names of the article's authors.
Fig. 3.4 summarises the steps in the standardisation and anonymisation process. All standardisation and anonymisation was conducted by three researchers native in English, Spanish and Arabic respectively who were not part of the review panel of the study.
Step 1: Reading of article to identify vandalism
After pasting the article into a MS Word document, standardisers were asked to read through the article to identify any vandalism (this was of particular importance for Wikipedia entries which are open to edition by any user). Vandalism was defined as any addition, removal or change of content in a deliberate attempt to compromise the integrity
22
