Yanpeng Wang, Dehai Zhang, Ye Yuan, Qing Liu, Yun Yang
{"title":"Improvement of TF-IDF Algorithm Based on Knowledge Graph","authors":"Yanpeng Wang, Dehai Zhang, Ye Yuan, Qing Liu, Yun Yang","doi":"10.1109/SERA.2018.8477196","DOIUrl":null,"url":null,"abstract":"The TF-IDF algorithm is commonly used for text information retrieval and data mining. The traditional TF-IDF algorithm does not consider the domain characteristics of the article, and does not consider the distribution ratio. Currently, the solution proposed by many scholars only solves the problems of distribution ratio and the like, and does not solve the problem that the domain keywords have unreasonable weights. The problem has led to the use of domain-specific applications where relevant keywords in some areas have not been given appropriate weights. This paper proposes an improved method based on domain knowledge graph. This method will mainly consider the application of the legal field, and use the legal knowledge graph to make improvements to the TF-IDF algorithm, so as to achieve the reasonable weight assigned to the domain-related keywords in text feature extraction. Experiments show that this method can effectively improving the accuracy of the extraction.","PeriodicalId":161568,"journal":{"name":"2018 IEEE 16th International Conference on Software Engineering Research, Management and Applications (SERA)","volume":"38 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"12","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 IEEE 16th International Conference on Software Engineering Research, Management and Applications (SERA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SERA.2018.8477196","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 12
Abstract
The TF-IDF algorithm is commonly used for text information retrieval and data mining. The traditional TF-IDF algorithm does not consider the domain characteristics of the article, and does not consider the distribution ratio. Currently, the solution proposed by many scholars only solves the problems of distribution ratio and the like, and does not solve the problem that the domain keywords have unreasonable weights. The problem has led to the use of domain-specific applications where relevant keywords in some areas have not been given appropriate weights. This paper proposes an improved method based on domain knowledge graph. This method will mainly consider the application of the legal field, and use the legal knowledge graph to make improvements to the TF-IDF algorithm, so as to achieve the reasonable weight assigned to the domain-related keywords in text feature extraction. Experiments show that this method can effectively improving the accuracy of the extraction.