RACHNA:种族恶作剧代码混合了印度语英语和新颖的语言增强

Shanu SidharthKumar Dhawale , Rahul Ponnusamy , Prasanna Kumar Kumaresan , Sajeetha Thavareesan , Saranya Rajiakodi , Bharathi Raja Chakravarthi
{"title":"RACHNA:种族恶作剧代码混合了印度语英语和新颖的语言增强","authors":"Shanu SidharthKumar Dhawale ,&nbsp;Rahul Ponnusamy ,&nbsp;Prasanna Kumar Kumaresan ,&nbsp;Sajeetha Thavareesan ,&nbsp;Saranya Rajiakodi ,&nbsp;Bharathi Raja Chakravarthi","doi":"10.1016/j.nlp.2025.100183","DOIUrl":null,"url":null,"abstract":"<div><div><strong>Warning</strong>: This paper contains derogatory language that may be offensive to some readers. As a type of misinformation, hoaxes seek to propagate incorrect information in order to gain popularity on social media. Racial hoaxes are a particular kind of hoax that is particularly harmful since they falsely link individuals or groups to crimes or incidents. This involves nuanced challenges of identifying false accusations, fabrications, and stereotypes that falsely impact other social, ethnic or out groups in negative actions. On the other hand, social media comments frequently incorporate many languages and are written in scripts that are not native to the user. They also rarely adhere to inflexible grammar norms. Lack of code-mixed racial hoax annotated data for a Low-resource languages like Code-Mixed Hindi and English make this issue more challenging. In order to address this, we collected 210,768 sentences and generated a racial hoax-annotated, code-mixed corpus of 5,105 YouTube comment postings in Hindi–English as HoaxMixPlus corpus. We outline the method of building the corpus and assigning the binary values indicating the presence of racial hoax which fills a critical gap in understanding and combating racialized misinformation along with inter-annotator agreement. We display the results of analysis, training using this corpus as a benchmark, new methodologies which includes dictionary based approach by correctly identifying code-mixed words as well as novel language augmentation strategies like transliteration and language tags. We evaluate several models on this dataset and demonstrate that our augmentation strategies lead to consistent performance gains.</div></div>","PeriodicalId":100944,"journal":{"name":"Natural Language Processing Journal","volume":"13 ","pages":"Article 100183"},"PeriodicalIF":0.0000,"publicationDate":"2025-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"RACHNA: Racial hoax code mixed Hindi–English with novel language augmentation\",\"authors\":\"Shanu SidharthKumar Dhawale ,&nbsp;Rahul Ponnusamy ,&nbsp;Prasanna Kumar Kumaresan ,&nbsp;Sajeetha Thavareesan ,&nbsp;Saranya Rajiakodi ,&nbsp;Bharathi Raja Chakravarthi\",\"doi\":\"10.1016/j.nlp.2025.100183\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div><strong>Warning</strong>: This paper contains derogatory language that may be offensive to some readers. As a type of misinformation, hoaxes seek to propagate incorrect information in order to gain popularity on social media. Racial hoaxes are a particular kind of hoax that is particularly harmful since they falsely link individuals or groups to crimes or incidents. This involves nuanced challenges of identifying false accusations, fabrications, and stereotypes that falsely impact other social, ethnic or out groups in negative actions. On the other hand, social media comments frequently incorporate many languages and are written in scripts that are not native to the user. They also rarely adhere to inflexible grammar norms. Lack of code-mixed racial hoax annotated data for a Low-resource languages like Code-Mixed Hindi and English make this issue more challenging. In order to address this, we collected 210,768 sentences and generated a racial hoax-annotated, code-mixed corpus of 5,105 YouTube comment postings in Hindi–English as HoaxMixPlus corpus. We outline the method of building the corpus and assigning the binary values indicating the presence of racial hoax which fills a critical gap in understanding and combating racialized misinformation along with inter-annotator agreement. We display the results of analysis, training using this corpus as a benchmark, new methodologies which includes dictionary based approach by correctly identifying code-mixed words as well as novel language augmentation strategies like transliteration and language tags. We evaluate several models on this dataset and demonstrate that our augmentation strategies lead to consistent performance gains.</div></div>\",\"PeriodicalId\":100944,\"journal\":{\"name\":\"Natural Language Processing Journal\",\"volume\":\"13 \",\"pages\":\"Article 100183\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2025-09-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Natural Language Processing Journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2949719125000597\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Natural Language Processing Journal","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2949719125000597","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

警告:本文包含贬损性语言,可能会冒犯一些读者。作为一种错误信息,恶作剧试图传播不正确的信息,以在社交媒体上获得人气。种族骗局是一种特别有害的恶作剧,因为它们错误地将个人或团体与犯罪或事件联系起来。这涉及识别虚假指控、捏造和刻板印象的微妙挑战,这些错误地影响了其他社会、种族或外部群体的负面行为。另一方面,社交媒体评论经常包含多种语言,并以非用户本地的脚本编写。他们也很少遵守僵化的语法规范。对于像code-mixed印地语和英语这样的低资源语言,缺乏代码混合的种族恶作剧注释数据使这个问题更具挑战性。为了解决这个问题,我们收集了210,768个句子,并生成了一个带有种族恶作剧注释、代码混合的5,105个印地语英语YouTube评论帖子的语料库HoaxMixPlus。我们概述了构建语料库和分配二元值的方法,表明种族骗局的存在,这填补了理解和打击种族化错误信息以及注释者间协议的关键空白。我们展示了分析的结果,以这个语料库为基准的训练,新的方法,包括基于字典的方法,通过正确识别代码混合词,以及新的语言增强策略,如音译和语言标签。我们在这个数据集上评估了几个模型,并证明了我们的增强策略带来了一致的性能提升。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
RACHNA: Racial hoax code mixed Hindi–English with novel language augmentation
Warning: This paper contains derogatory language that may be offensive to some readers. As a type of misinformation, hoaxes seek to propagate incorrect information in order to gain popularity on social media. Racial hoaxes are a particular kind of hoax that is particularly harmful since they falsely link individuals or groups to crimes or incidents. This involves nuanced challenges of identifying false accusations, fabrications, and stereotypes that falsely impact other social, ethnic or out groups in negative actions. On the other hand, social media comments frequently incorporate many languages and are written in scripts that are not native to the user. They also rarely adhere to inflexible grammar norms. Lack of code-mixed racial hoax annotated data for a Low-resource languages like Code-Mixed Hindi and English make this issue more challenging. In order to address this, we collected 210,768 sentences and generated a racial hoax-annotated, code-mixed corpus of 5,105 YouTube comment postings in Hindi–English as HoaxMixPlus corpus. We outline the method of building the corpus and assigning the binary values indicating the presence of racial hoax which fills a critical gap in understanding and combating racialized misinformation along with inter-annotator agreement. We display the results of analysis, training using this corpus as a benchmark, new methodologies which includes dictionary based approach by correctly identifying code-mixed words as well as novel language augmentation strategies like transliteration and language tags. We evaluate several models on this dataset and demonstrate that our augmentation strategies lead to consistent performance gains.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信