ARABICNLP Pub Date : 2024-01-23 DOI: 10.18653/v1/2023.arabicnlp-1.81

Mohammed Elkomy, Amany Sarhan

引用次数: 0

USTHB at NADI 2023 shared task: Exploring Preprocessing and Feature Engineering Strategies for Arabic Dialect Identification 人与生物圈计划在 NADI 2023 上的共同任务：探索阿拉伯语方言识别的预处理和特征工程策略

ARABICNLP Pub Date : 2023-12-16 DOI: 10.18653/v1/2023.arabicnlp-1.69

Mohamed Lichouri, Khaled Lounnas, Aicha Zitouni, H. Latrache, R. Djeradi

引用次数: 0

Beyond English: Evaluating LLMs for Arabic Grammatical Error Correction 超越英语：阿拉伯语语法纠错 LLM 评估

ARABICNLP Pub Date : 2023-12-13 DOI: 10.18653/v1/2023.arabicnlp-1.9

S. Kwon, Gagan Bhatia, El Moatez Billah Nagoudi, M. Abdul-Mageed

{"title":"Beyond English: Evaluating LLMs for Arabic Grammatical Error Correction","authors":"S. Kwon, Gagan Bhatia, El Moatez Billah Nagoudi, M. Abdul-Mageed","doi":"10.18653/v1/2023.arabicnlp-1.9","DOIUrl":"https://doi.org/10.18653/v1/2023.arabicnlp-1.9","url":null,"abstract":"Large language models (LLMs) finetuned to follow human instruction have recently exhibited significant capabilities in various English NLP tasks. However, their performance in grammatical error correction (GEC), especially on languages other than English, remains significantly unexplored. In this work, we evaluate the abilities of instruction finetuned LLMs in Arabic GEC, a complex task due to Arabic’s rich morphology. Our findings suggest that various prompting methods, coupled with (in-context) few-shot learning, demonstrate considerable effectiveness, with GPT-4 achieving up to 65.49 F1 score under expert prompting (approximately 5 points higher than our established baseline). Despite these positive results, we find that instruction finetuned models, regardless of their size, are still outperformed by fully finetuned ones, even if they are significantly smaller in size. This disparity highlights substantial room for improvements for LLMs. Inspired by methods used in low-resource machine translation, we also develop a method exploiting synthetic data that significantly outperforms previous models on two standard Arabic benchmarks. Our best model achieves a new SOTA on Arabic GEC, with 73.29 and 73.26 F1 on the 2014 and 2015 QALB datasets, respectively, compared to peer-reviewed published baselines.","PeriodicalId":503921,"journal":{"name":"ARABICNLP","volume":"192 1","pages":"101-119"},"PeriodicalIF":0.0,"publicationDate":"2023-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139181302","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Mavericks at ArAIEval Shared Task: Towards a Safer Digital Space - Transformer Ensemble Models Tackling Deception and Persuasion ArAIEval 上的特立独行者共同任务：迈向更安全的数字空间--处理欺骗和劝诱问题的变换器集合模型

ARABICNLP Pub Date : 2023-11-30 DOI: 10.48550/arXiv.2311.18730

Sudeep Mangalvedhekar, Kshitij Deshpande, Yash Patwardhan, Vedant Deshpande, Ravindra Murumkar

引用次数: 0

Violet: A Vision-Language Model for Arabic Image Captioning with Gemini Decoder 紫罗兰使用双子座解码器为阿拉伯语图像添加字幕的视觉语言模型

ARABICNLP Pub Date : 2023-11-15 DOI: 10.48550/arXiv.2311.08844

Abdelrahman Mohamed, Fakhraddin Alwajih, El Moatez Billah Nagoudi, Alcides Alcoba Inciarte, M. Abdul-Mageed

引用次数: 0

ARABICNLP最新文献