Yuxin Xie, Jiang Yang, Tai-yong fei, Baochun Yu, Xin Hu
{"title":"基于改进RAKE的中文专业领域文本关键字提取方法","authors":"Yuxin Xie, Jiang Yang, Tai-yong fei, Baochun Yu, Xin Hu","doi":"10.1117/12.2667258","DOIUrl":null,"url":null,"abstract":"An improved RAKE (Rapid Automatic Keyword Extraction) algorithm is proposed to solve the problems of phrase conglutination and inability to obtain professional words in the process of extracting keywords from Chinese professional texts. Through the TTF-IDF (Total Term Frequency-Inverse Document Frequency) method, professional field stop words are extracted and added to the general stop word dictionary for phrase segmentation. Professional domain entity words are introduced into the general word segmentation dictionary, and appropriate weight is given to them in the degree calculation to ensure that professional entity words get higher scores and are effectively extracted as keywords, because in professional field texts, professional entity words contain more core information. The experiments show that this algorithm is better than the basic RAKE and other algorithms in keyword extraction for Chinese professional field texts.","PeriodicalId":128051,"journal":{"name":"Third International Seminar on Artificial Intelligence, Networking, and Information Technology","volume":"295 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-02-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A keyword extraction method for Chinese professional field text based on improved RAKE\",\"authors\":\"Yuxin Xie, Jiang Yang, Tai-yong fei, Baochun Yu, Xin Hu\",\"doi\":\"10.1117/12.2667258\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"An improved RAKE (Rapid Automatic Keyword Extraction) algorithm is proposed to solve the problems of phrase conglutination and inability to obtain professional words in the process of extracting keywords from Chinese professional texts. Through the TTF-IDF (Total Term Frequency-Inverse Document Frequency) method, professional field stop words are extracted and added to the general stop word dictionary for phrase segmentation. Professional domain entity words are introduced into the general word segmentation dictionary, and appropriate weight is given to them in the degree calculation to ensure that professional entity words get higher scores and are effectively extracted as keywords, because in professional field texts, professional entity words contain more core information. The experiments show that this algorithm is better than the basic RAKE and other algorithms in keyword extraction for Chinese professional field texts.\",\"PeriodicalId\":128051,\"journal\":{\"name\":\"Third International Seminar on Artificial Intelligence, Networking, and Information Technology\",\"volume\":\"295 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-02-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Third International Seminar on Artificial Intelligence, Networking, and Information Technology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2667258\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Third International Seminar on Artificial Intelligence, Networking, and Information Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2667258","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
针对中文专业文本关键词提取过程中存在的词组粘连和无法获取专业词等问题,提出了一种改进的RAKE(快速自动关键词提取)算法。通过TTF-IDF (Total Term Frequency- inverse Document Frequency)方法提取专业字段停词,并将其加入通用停词词典中进行短语分词。在通用分词词典中引入专业领域实体词,并在度计算中给予适当的权重,以保证专业领域实体词得到更高的分数,并作为关键字被有效提取,因为在专业领域文本中,专业实体词包含更多的核心信息。实验表明,该算法在中文专业领域文本关键字提取方面优于基本的RAKE算法和其他算法。
A keyword extraction method for Chinese professional field text based on improved RAKE
An improved RAKE (Rapid Automatic Keyword Extraction) algorithm is proposed to solve the problems of phrase conglutination and inability to obtain professional words in the process of extracting keywords from Chinese professional texts. Through the TTF-IDF (Total Term Frequency-Inverse Document Frequency) method, professional field stop words are extracted and added to the general stop word dictionary for phrase segmentation. Professional domain entity words are introduced into the general word segmentation dictionary, and appropriate weight is given to them in the degree calculation to ensure that professional entity words get higher scores and are effectively extracted as keywords, because in professional field texts, professional entity words contain more core information. The experiments show that this algorithm is better than the basic RAKE and other algorithms in keyword extraction for Chinese professional field texts.