基于LSA和FSVM的垃圾邮件过滤方法

Jingtao Sun, Qiuyu Zhang, Zhanting Yuan, Wenhan Huang, Xiaowen Yan, Jianshe Dong
{"title":"基于LSA和FSVM的垃圾邮件过滤方法","authors":"Jingtao Sun, Qiuyu Zhang, Zhanting Yuan, Wenhan Huang, Xiaowen Yan, Jianshe Dong","doi":"10.1109/FSKD.2008.656","DOIUrl":null,"url":null,"abstract":"When we apply SVM (support vector machine) method to filter spam, there will be a problem that data sets are too large to be solved in the algorithm. So we present a novel approach which is a method of combination of LSA (latent semantic analysis) and FSVM (fuzzy support vector machine). In the process of data set building, we adopt LSA method to handle the problem which data sets lies in implicit semantic kindred words and yawp words. Meanwhile, the data sets will be decreased by using this method and it improves the training efficiency largely. Experimental results show that this method outperformed the SVM and Nave Byes filter algorithm in aspect of recall rate. In 3 kinds of methods, the function of combination of LSA and FSVM is better than otherpsilas and its ability of classification identifies is best among them. The experiments show the expected results obtained, and the feasibility and advantage of the new method is validated.","PeriodicalId":208332,"journal":{"name":"2008 Fifth International Conference on Fuzzy Systems and Knowledge Discovery","volume":"8 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2008-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"A Junk Mail Filtering Method Based on LSA and FSVM\",\"authors\":\"Jingtao Sun, Qiuyu Zhang, Zhanting Yuan, Wenhan Huang, Xiaowen Yan, Jianshe Dong\",\"doi\":\"10.1109/FSKD.2008.656\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"When we apply SVM (support vector machine) method to filter spam, there will be a problem that data sets are too large to be solved in the algorithm. So we present a novel approach which is a method of combination of LSA (latent semantic analysis) and FSVM (fuzzy support vector machine). In the process of data set building, we adopt LSA method to handle the problem which data sets lies in implicit semantic kindred words and yawp words. Meanwhile, the data sets will be decreased by using this method and it improves the training efficiency largely. Experimental results show that this method outperformed the SVM and Nave Byes filter algorithm in aspect of recall rate. In 3 kinds of methods, the function of combination of LSA and FSVM is better than otherpsilas and its ability of classification identifies is best among them. The experiments show the expected results obtained, and the feasibility and advantage of the new method is validated.\",\"PeriodicalId\":208332,\"journal\":{\"name\":\"2008 Fifth International Conference on Fuzzy Systems and Knowledge Discovery\",\"volume\":\"8 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2008-10-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2008 Fifth International Conference on Fuzzy Systems and Knowledge Discovery\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/FSKD.2008.656\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2008 Fifth International Conference on Fuzzy Systems and Knowledge Discovery","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/FSKD.2008.656","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 3

摘要

当我们使用支持向量机方法过滤垃圾邮件时,会遇到数据集太大而无法解决的问题。为此,我们提出了一种将潜在语义分析(LSA)和模糊支持向量机(FSVM)相结合的方法。在数据集的构建过程中,我们采用LSA方法来处理数据集存在隐式语义类词和噪声词的问题。同时,使用该方法可以减少数据集,大大提高了训练效率。实验结果表明,该方法在查全率方面优于SVM和Nave Byes滤波算法。在3种方法中,LSA与FSVM结合的功能优于其他方法,分类识别能力最好。实验结果表明,该方法达到了预期的效果,验证了新方法的可行性和优越性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A Junk Mail Filtering Method Based on LSA and FSVM
When we apply SVM (support vector machine) method to filter spam, there will be a problem that data sets are too large to be solved in the algorithm. So we present a novel approach which is a method of combination of LSA (latent semantic analysis) and FSVM (fuzzy support vector machine). In the process of data set building, we adopt LSA method to handle the problem which data sets lies in implicit semantic kindred words and yawp words. Meanwhile, the data sets will be decreased by using this method and it improves the training efficiency largely. Experimental results show that this method outperformed the SVM and Nave Byes filter algorithm in aspect of recall rate. In 3 kinds of methods, the function of combination of LSA and FSVM is better than otherpsilas and its ability of classification identifies is best among them. The experiments show the expected results obtained, and the feasibility and advantage of the new method is validated.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信