Research and Realization of Extraction Algorithm on Web Text Mining

Abstract

Now people use the search engine - Google, Yahoo, Baidu etc. to lookup Web information mainly, but these search engines involve so wide range, with whose intelligence degree is pool. They are very difficult to mine data further. So, Web text mining aims to resolve this problem. This paper discusses an algorithm of how to follow the appointed Web site or Web page according to the user's request by using the technique of ASP (Active Serve Page), and research and realization how further obtains data of particular range in Internet by text extraction on Web mining. The method has more accuracy, better applicability and less manual interference. The information obtained are the majority of the documents in the field, it can be used to create knowledge database, and it can also be treated as a small scaled vertical search system.