基于孟加拉语作者归属数据集的停顿词文体作用分析

IF 4.8 2区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Abdullah Muhammad Moosa, Nusrat Sultana, Mahdi Muhammad Moosa, Md Miraiz Hossain
{"title":"基于孟加拉语作者归属数据集的停顿词文体作用分析","authors":"Abdullah Muhammad Moosa,&nbsp;Nusrat Sultana,&nbsp;Mahdi Muhammad Moosa,&nbsp;Md Miraiz Hossain","doi":"10.1155/int/2588181","DOIUrl":null,"url":null,"abstract":"<p>Stop-word removal is a common preprocessing step in natural language processing, but in authorship attribution, frequent function words may preserve important stylistic information. For Bangla, the effect of stop-word removal remains insufficiently examined, particularly beyond literary corpora and under consistent comparisons between classical and neural models. This study introduces the Bangla Authorship Recognition Dataset of 10 Authors (BARD10), a curated dataset of 2337 postlevel texts from 10 contemporary Bangla authors, and evaluates it alongside the literary benchmark Bangla Authorship Attribution Dataset (BAAD16). We compare four model families: support vector machine (SVM), eXtreme Gradient Boosting (XGBoost), an embedding-based multilayer perceptron (MLP), and BanglaBERT, a Bangla-adapted bidirectional encoder representations from transformers (BERT) model, under stop-word–retained and stop-word–removed conditions. For the classical models, we further examine word-level, character-level, and subword-level term frequency–inverse document frequency (TF–IDF) representations. Across both datasets, sparse TF–IDF features combined with linear SVM achieve the strongest overall performance, reaching a macro-F1 of 0.9956 on BAAD16 and 0.9232 ± 0.0086 on BARD10. BanglaBERT remains competitive but does not surpass the best sparse-feature configurations. The results show that the effect of stop-word removal is not uniform across models, tokenization settings, or datasets. In particular, stop-words often preserve useful authorial information in BARD10, indicating their importance in contemporary online Bangla writing. A word-level Δ-recall analysis further shows that individual stop-word effects are heterogeneous and author-dependent. These findings suggest that Bangla stop-words should not be treated as uniformly disposable preprocessing noise and that interpretable sparse-feature baselines remain essential reference points for Bangla authorship attribution.</p>","PeriodicalId":14089,"journal":{"name":"International Journal of Intelligent Systems","volume":"2026 1","pages":""},"PeriodicalIF":4.8000,"publicationDate":"2026-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1155/int/2588181","citationCount":"0","resultStr":"{\"title\":\"BARD10: A Bangla Authorship Attribution Dataset for Analyzing the Stylistic Role of Stop-Words\",\"authors\":\"Abdullah Muhammad Moosa,&nbsp;Nusrat Sultana,&nbsp;Mahdi Muhammad Moosa,&nbsp;Md Miraiz Hossain\",\"doi\":\"10.1155/int/2588181\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Stop-word removal is a common preprocessing step in natural language processing, but in authorship attribution, frequent function words may preserve important stylistic information. For Bangla, the effect of stop-word removal remains insufficiently examined, particularly beyond literary corpora and under consistent comparisons between classical and neural models. This study introduces the Bangla Authorship Recognition Dataset of 10 Authors (BARD10), a curated dataset of 2337 postlevel texts from 10 contemporary Bangla authors, and evaluates it alongside the literary benchmark Bangla Authorship Attribution Dataset (BAAD16). We compare four model families: support vector machine (SVM), eXtreme Gradient Boosting (XGBoost), an embedding-based multilayer perceptron (MLP), and BanglaBERT, a Bangla-adapted bidirectional encoder representations from transformers (BERT) model, under stop-word–retained and stop-word–removed conditions. For the classical models, we further examine word-level, character-level, and subword-level term frequency–inverse document frequency (TF–IDF) representations. Across both datasets, sparse TF–IDF features combined with linear SVM achieve the strongest overall performance, reaching a macro-F1 of 0.9956 on BAAD16 and 0.9232 ± 0.0086 on BARD10. BanglaBERT remains competitive but does not surpass the best sparse-feature configurations. The results show that the effect of stop-word removal is not uniform across models, tokenization settings, or datasets. In particular, stop-words often preserve useful authorial information in BARD10, indicating their importance in contemporary online Bangla writing. A word-level Δ-recall analysis further shows that individual stop-word effects are heterogeneous and author-dependent. These findings suggest that Bangla stop-words should not be treated as uniformly disposable preprocessing noise and that interpretable sparse-feature baselines remain essential reference points for Bangla authorship attribution.</p>\",\"PeriodicalId\":14089,\"journal\":{\"name\":\"International Journal of Intelligent Systems\",\"volume\":\"2026 1\",\"pages\":\"\"},\"PeriodicalIF\":4.8000,\"publicationDate\":\"2026-10-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1155/int/2588181\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Intelligent Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1155/int/2588181\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Intelligent Systems","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1155/int/2588181","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

停止词去除是自然语言处理中常见的预处理步骤,但在作者归属中,频繁出现的虚词可能会保留重要的文体信息。对于孟加拉语,停止词去除的效果仍然没有得到充分的研究,特别是在文学语料库之外,以及在经典和神经模型之间的一致比较下。本研究引入了10位作者的孟加拉作者身份识别数据集(BARD10),这是一个来自10位当代孟加拉作家的2337篇后期文本的精选数据集,并与文学基准孟加拉作者身份归属数据集(BAAD16)一起对其进行了评估。我们比较了四种模型族:支持向量机(SVM)、基于嵌入的多层感知器(MLP)的极端梯度增强(XGBoost)和BanglaBERT(一种自适应孟加拉语的双向编码器表示,来自变压器(BERT)模型)在保留和删除停止词条件下的表现。对于经典模型,我们进一步研究了词级、字符级和子词级术语频率逆文档频率(TF-IDF)表示。在两个数据集上,稀疏TF-IDF特征结合线性支持向量机的整体性能最强,在BAAD16上达到0.9956的宏观f1,在BARD10上达到0.9232±0.0086。BanglaBERT仍然具有竞争力,但没有超越最佳的稀疏特征配置。结果表明,在不同的模型、标记设置或数据集中,停止词去除的效果并不一致。特别是,停顿词在BARD10中经常保留有用的作者信息,表明它们在当代在线孟加拉语写作中的重要性。单词级Δ-recall分析进一步表明,个体停词效应是异质的,并且依赖于作者。这些发现表明,孟加拉语停止词不应被视为统一的一次性预处理噪声,可解释的稀疏特征基线仍然是孟加拉语作者归属的重要参考点。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
BARD10: A Bangla Authorship Attribution Dataset for Analyzing the Stylistic Role of Stop-Words

Stop-word removal is a common preprocessing step in natural language processing, but in authorship attribution, frequent function words may preserve important stylistic information. For Bangla, the effect of stop-word removal remains insufficiently examined, particularly beyond literary corpora and under consistent comparisons between classical and neural models. This study introduces the Bangla Authorship Recognition Dataset of 10 Authors (BARD10), a curated dataset of 2337 postlevel texts from 10 contemporary Bangla authors, and evaluates it alongside the literary benchmark Bangla Authorship Attribution Dataset (BAAD16). We compare four model families: support vector machine (SVM), eXtreme Gradient Boosting (XGBoost), an embedding-based multilayer perceptron (MLP), and BanglaBERT, a Bangla-adapted bidirectional encoder representations from transformers (BERT) model, under stop-word–retained and stop-word–removed conditions. For the classical models, we further examine word-level, character-level, and subword-level term frequency–inverse document frequency (TF–IDF) representations. Across both datasets, sparse TF–IDF features combined with linear SVM achieve the strongest overall performance, reaching a macro-F1 of 0.9956 on BAAD16 and 0.9232 ± 0.0086 on BARD10. BanglaBERT remains competitive but does not surpass the best sparse-feature configurations. The results show that the effect of stop-word removal is not uniform across models, tokenization settings, or datasets. In particular, stop-words often preserve useful authorial information in BARD10, indicating their importance in contemporary online Bangla writing. A word-level Δ-recall analysis further shows that individual stop-word effects are heterogeneous and author-dependent. These findings suggest that Bangla stop-words should not be treated as uniformly disposable preprocessing noise and that interpretable sparse-feature baselines remain essential reference points for Bangla authorship attribution.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
International Journal of Intelligent Systems
International Journal of Intelligent Systems 工程技术-计算机:人工智能
CiteScore
11.30
自引率
14.30%
发文量
304
审稿时长
9 months
期刊介绍: The International Journal of Intelligent Systems serves as a forum for individuals interested in tapping into the vast theories based on intelligent systems construction. With its peer-reviewed format, the journal explores several fascinating editorials written by today''s experts in the field. Because new developments are being introduced each day, there''s much to be learned — examination, analysis creation, information retrieval, man–computer interactions, and more. The International Journal of Intelligent Systems uses charts and illustrations to demonstrate these ground-breaking issues, and encourages readers to share their thoughts and experiences.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书