Focused crawling with ontology using semi-automatic tagging for relevancy

Abstract

World Wide Web (WWW) is considered to be the most important source of information now a days but it's difficult to decide which resources are useful and which are more important. Thus to make a specific part of web leading to only the required resources is searched for. The focused crawler crawl a specific part of the web to retrieve the relevant resources. Here in this paper the focused crawler is applied on social network having ontology dependent tags. The ontology here is also used in preprocessing step of focused crawlers to make the search more specific by expanding the search topic semantically. Further the relevancy of manually tagged and semi-automatically tagged resource is compared. Then finally the harvest rate is evaluated for focused crawlers with ontology and using semi-automatic tagging to check for the relevance.