Efficient Search Structures for Wikipedia based on User Communities

Abstract

Wikipedia is a free, web-based encyclopaedia with over 3.5 million articles in English. The graph structure of Wikipedia contains the articles as nodes and the links between the articles as the edges. In Wikipedia information is maintained using MySQL schemas. The problem with relational systems is that it is not suitable to maintain adhoc, dynamic, complex and deeply associative information. The vast amount of information in Wikipedia requires the use of specialised databases and data structures to enable efficient search. This paper proposes persistent and in-memory structures for Wikipedia articles considering both the link and content information. Further personalisation and improvement of search efficiency can be brought about by group personalisation. Personalisation at the user level and group level are considered. It maps the persistent structure consisting of group and community information to in-memory B+ Tree graph structure for a particular user. Experimental results demonstrate the efficiency of the proposed approach.