{"title":"基于特征段技术的文本分类中关键字与关键短语的比较","authors":"V. Nuipian, P. Meesad, P. Boonrawd","doi":"10.1109/ICTKE.2012.6152398","DOIUrl":null,"url":null,"abstract":"Text categorization is the main issue which affects search results. Moreover, most approaches suffer from the high dimensionality of feature space. To overcome this problem, the use of feature selection techniques with statistical text categorization is investigated. The methods were evaluated based on Chi-Square, Information Gain and Gain Ratio. The data used to test the system consisted of 1,510 documents from 2009-2010, word segmentation algorithm to key-phrase 4,408 attributes and single word 2,184 attributes. Classification techniques applied Decision Tree (ID3), Naïve Bayes (NB), Support Vector Machine (SVM) and k-nearest neighbor (KNN). Results showed that the Support Vector Machine was found to be the best technique with accuracy of a single word at 84% and key-phrase at 74% based on feature selection with Chi-Square, Information Gain and Gain Ratio with F-measure. In future research, application of text to the semantic system should be investigated further.","PeriodicalId":235347,"journal":{"name":"2011 Ninth International Conference on ICT and Knowledge Engineering","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2012-02-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"A comparison between keywords and key-phrases in text categorization using feature section technique\",\"authors\":\"V. Nuipian, P. Meesad, P. Boonrawd\",\"doi\":\"10.1109/ICTKE.2012.6152398\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Text categorization is the main issue which affects search results. Moreover, most approaches suffer from the high dimensionality of feature space. To overcome this problem, the use of feature selection techniques with statistical text categorization is investigated. The methods were evaluated based on Chi-Square, Information Gain and Gain Ratio. The data used to test the system consisted of 1,510 documents from 2009-2010, word segmentation algorithm to key-phrase 4,408 attributes and single word 2,184 attributes. Classification techniques applied Decision Tree (ID3), Naïve Bayes (NB), Support Vector Machine (SVM) and k-nearest neighbor (KNN). Results showed that the Support Vector Machine was found to be the best technique with accuracy of a single word at 84% and key-phrase at 74% based on feature selection with Chi-Square, Information Gain and Gain Ratio with F-measure. In future research, application of text to the semantic system should be investigated further.\",\"PeriodicalId\":235347,\"journal\":{\"name\":\"2011 Ninth International Conference on ICT and Knowledge Engineering\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2012-02-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2011 Ninth International Conference on ICT and Knowledge Engineering\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICTKE.2012.6152398\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2011 Ninth International Conference on ICT and Knowledge Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICTKE.2012.6152398","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A comparison between keywords and key-phrases in text categorization using feature section technique
Text categorization is the main issue which affects search results. Moreover, most approaches suffer from the high dimensionality of feature space. To overcome this problem, the use of feature selection techniques with statistical text categorization is investigated. The methods were evaluated based on Chi-Square, Information Gain and Gain Ratio. The data used to test the system consisted of 1,510 documents from 2009-2010, word segmentation algorithm to key-phrase 4,408 attributes and single word 2,184 attributes. Classification techniques applied Decision Tree (ID3), Naïve Bayes (NB), Support Vector Machine (SVM) and k-nearest neighbor (KNN). Results showed that the Support Vector Machine was found to be the best technique with accuracy of a single word at 84% and key-phrase at 74% based on feature selection with Chi-Square, Information Gain and Gain Ratio with F-measure. In future research, application of text to the semantic system should be investigated further.