机器学习检测孟加拉语仇恨言论的实现

Shovon Ahammed, Mostafizur Rahman, Mahedi Hasan Niloy, S. A. Chowdhury
{"title":"机器学习检测孟加拉语仇恨言论的实现","authors":"Shovon Ahammed, Mostafizur Rahman, Mahedi Hasan Niloy, S. A. Chowdhury","doi":"10.1109/SMART46866.2019.9117214","DOIUrl":null,"url":null,"abstract":"Hate speech is a crime in all countries. Hate speech can be for women, religions, countries, cultures. The big problem for hate speech is that it entices the evil people. Moreover, it inspires them to spread hatred in the society. Bangla is one of the topmost spoken languages in the world. But hate speech detection in Bangla language is rare. Our purpose is to detect hate speech in Bangla language. To perform the task, we were in need of the Bangla datasets. But the Bangla dataset is not available. So, we have collected data from Facebook. Collecting data from the social site is very hectic. The data contain mixed languages, grammatical mistakes. So, we made a team to collect the data. Another team was to process the data. And finally, we labeled the data as hate speech or not. The team members had enough knowledge about hate speech. They were neutral towards the data. Our data contain hate speech against women, community, culture, ethnicity, race, sex, disability. Machine Learning approach is ideal for our work. We have used the SVM and Naïve Bayes algorithm for our work and got a maximum accuracy of 72%.","PeriodicalId":328124,"journal":{"name":"2019 8th International Conference System Modeling and Advancement in Research Trends (SMART)","volume":"44 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"14","resultStr":"{\"title\":\"Implementation of Machine Learning to Detect Hate Speech in Bangla Language\",\"authors\":\"Shovon Ahammed, Mostafizur Rahman, Mahedi Hasan Niloy, S. A. Chowdhury\",\"doi\":\"10.1109/SMART46866.2019.9117214\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Hate speech is a crime in all countries. Hate speech can be for women, religions, countries, cultures. The big problem for hate speech is that it entices the evil people. Moreover, it inspires them to spread hatred in the society. Bangla is one of the topmost spoken languages in the world. But hate speech detection in Bangla language is rare. Our purpose is to detect hate speech in Bangla language. To perform the task, we were in need of the Bangla datasets. But the Bangla dataset is not available. So, we have collected data from Facebook. Collecting data from the social site is very hectic. The data contain mixed languages, grammatical mistakes. So, we made a team to collect the data. Another team was to process the data. And finally, we labeled the data as hate speech or not. The team members had enough knowledge about hate speech. They were neutral towards the data. Our data contain hate speech against women, community, culture, ethnicity, race, sex, disability. Machine Learning approach is ideal for our work. We have used the SVM and Naïve Bayes algorithm for our work and got a maximum accuracy of 72%.\",\"PeriodicalId\":328124,\"journal\":{\"name\":\"2019 8th International Conference System Modeling and Advancement in Research Trends (SMART)\",\"volume\":\"44 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"14\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2019 8th International Conference System Modeling and Advancement in Research Trends (SMART)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/SMART46866.2019.9117214\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 8th International Conference System Modeling and Advancement in Research Trends (SMART)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SMART46866.2019.9117214","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 14

摘要

仇恨言论在所有国家都是犯罪。仇恨言论可以针对女性、宗教、国家、文化。仇恨言论的最大问题是它会引诱邪恶的人。此外,它激发了他们在社会上传播仇恨。孟加拉语是世界上使用人数最多的语言之一。但在孟加拉语中,仇恨言论检测是罕见的。我们的目的是检测孟加拉语的仇恨言论。为了完成这个任务,我们需要孟加拉语数据集。但是孟加拉国的数据集是不可用的。我们从Facebook上收集了数据。从社交网站收集数据是非常忙碌的。数据中混杂着语言和语法错误。所以,我们成立了一个小组来收集数据。另一个小组负责处理数据。最后,我们将数据标记为仇恨言论或非仇恨言论。团队成员对仇恨言论有足够的了解。他们对数据持中立态度。我们的数据包含针对女性、社区、文化、民族、种族、性别、残疾的仇恨言论。机器学习方法非常适合我们的工作。我们使用支持向量机和Naïve贝叶斯算法进行我们的工作,并获得了72%的最高准确率。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Implementation of Machine Learning to Detect Hate Speech in Bangla Language
Hate speech is a crime in all countries. Hate speech can be for women, religions, countries, cultures. The big problem for hate speech is that it entices the evil people. Moreover, it inspires them to spread hatred in the society. Bangla is one of the topmost spoken languages in the world. But hate speech detection in Bangla language is rare. Our purpose is to detect hate speech in Bangla language. To perform the task, we were in need of the Bangla datasets. But the Bangla dataset is not available. So, we have collected data from Facebook. Collecting data from the social site is very hectic. The data contain mixed languages, grammatical mistakes. So, we made a team to collect the data. Another team was to process the data. And finally, we labeled the data as hate speech or not. The team members had enough knowledge about hate speech. They were neutral towards the data. Our data contain hate speech against women, community, culture, ethnicity, race, sex, disability. Machine Learning approach is ideal for our work. We have used the SVM and Naïve Bayes algorithm for our work and got a maximum accuracy of 72%.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信