Similarity Computation of Web Pages

Abstract

Web page is the main contents on the World Wide Web. Similarity of Web pages is very helpful for Web content analysis. Text similarity, usually called similarity computation, has been investigated for decades in artificial intelligence area. Some similarity computation methods have been used to compare Web pages. However, text based similarity computation methods are incompetent for Web page comparing, because Web page consists of not only text but also multimedia contents, such as image, audio, video and so on. This paper proposes a new approach to evaluate the similarity of Web pages considering all the contents on them. It can make Web page similarity computation exactly and bring benefits for Web analysis.