基于半监督学习的支持向量机短文本分类新方法

Chunyong Yin, Jun Xiang, Hui Zhang, Jin Wang, Zhichao Yin, Jeong-Uk Kim
{"title":"基于半监督学习的支持向量机短文本分类新方法","authors":"Chunyong Yin, Jun Xiang, Hui Zhang, Jin Wang, Zhichao Yin, Jeong-Uk Kim","doi":"10.1109/AITS.2015.34","DOIUrl":null,"url":null,"abstract":"Short text is a popular text form, which is widely used in short commentary, micro-blog and many other fields. With the development of the social software and movie websites, the size of data is also becoming larger and larger. Most data is useless for us while other data is important for us. Therefore, it is very necessary for us to extract the useful short text from the big data. However, there are some problems such as fewer features, irregularity on the short text classification. To solve the problem we should pretreat the short text set and choose the significant features. This paper use semi-supervised learning and SVM to improve the traditional method and it can classify a large number of short texts to mining the useful massage from the short text. The experimental results also show a good improvement.","PeriodicalId":196795,"journal":{"name":"2015 4th International Conference on Advanced Information Technology and Sensor Application (AITS)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2015-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"44","resultStr":"{\"title\":\"A New SVM Method for Short Text Classification Based on Semi-Supervised Learning\",\"authors\":\"Chunyong Yin, Jun Xiang, Hui Zhang, Jin Wang, Zhichao Yin, Jeong-Uk Kim\",\"doi\":\"10.1109/AITS.2015.34\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Short text is a popular text form, which is widely used in short commentary, micro-blog and many other fields. With the development of the social software and movie websites, the size of data is also becoming larger and larger. Most data is useless for us while other data is important for us. Therefore, it is very necessary for us to extract the useful short text from the big data. However, there are some problems such as fewer features, irregularity on the short text classification. To solve the problem we should pretreat the short text set and choose the significant features. This paper use semi-supervised learning and SVM to improve the traditional method and it can classify a large number of short texts to mining the useful massage from the short text. The experimental results also show a good improvement.\",\"PeriodicalId\":196795,\"journal\":{\"name\":\"2015 4th International Conference on Advanced Information Technology and Sensor Application (AITS)\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2015-08-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"44\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2015 4th International Conference on Advanced Information Technology and Sensor Application (AITS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/AITS.2015.34\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2015 4th International Conference on Advanced Information Technology and Sensor Application (AITS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/AITS.2015.34","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 44

摘要

短文本是一种流行的文本形式,被广泛应用于短文评论、微博等诸多领域。随着社交软件和电影网站的发展,数据的规模也越来越大。大多数数据对我们来说是无用的,而其他数据对我们来说是重要的。因此,从大数据中提取有用的短文本对我们来说是非常必要的。然而,目前的短文本分类存在特征较少、不规范等问题。为了解决这个问题,我们应该对短文本集进行预处理,选择显著特征。本文利用半监督学习和支持向量机对传统方法进行改进,可以对大量的短文本进行分类,从短文本中挖掘出有用的信息。实验结果也显示出较好的改进。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A New SVM Method for Short Text Classification Based on Semi-Supervised Learning
Short text is a popular text form, which is widely used in short commentary, micro-blog and many other fields. With the development of the social software and movie websites, the size of data is also becoming larger and larger. Most data is useless for us while other data is important for us. Therefore, it is very necessary for us to extract the useful short text from the big data. However, there are some problems such as fewer features, irregularity on the short text classification. To solve the problem we should pretreat the short text set and choose the significant features. This paper use semi-supervised learning and SVM to improve the traditional method and it can classify a large number of short texts to mining the useful massage from the short text. The experimental results also show a good improvement.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信