Structural Analyses of Malaysian Web and Host Graphs

Abstract

In this paper, we present our study on building a Web graph for the Malaysian Web based on the crawling of Malaysian Web sites. Given the constructed Web graph, interesting characteristics have been studied, such as the in-degree, out-degree, the distribution of power law, bow-tie structure and the strongly-connected components (SCCs). Besides, more important insight could be obtained from analyzing the hyperlinks among the hosts. Similar to Web graph, host graph serves as an informative source for enhancing crawling and searching methodologies, predicting Web growth and for Web sociology study. To date, Web or host graphs have been built for the global Web and other nations. Hence, being a subset of the global Web, it would also be interesting to compare the characteristics of Malaysian host graph with the global Web and other nations'. This research outputs a Malaysian Web graph, a Malaysian host graph and studies on the characteristics of these graphs. The graphs portray characteristics that are consistent with the graphs created for other nations. There are irregularities to the graphs where it is discussed at length to justify to anomalies.