AC-IQuAD: Automatically Constructed Indonesian Question Answering Dataset by Leveraging Wikidata

IF 1.7 3区计算机科学 Q3 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS

Language Resources and Evaluation Pub Date : 2024-01-03 DOI:10.1007/s10579-023-09702-y

Kerenza Doxolodeo, Adila Alfa Krisnadhi

引用次数: 0

Abstract

Constructing a question-answering dataset can be prohibitively expensive, making it difficult for researchers to make one for an under-resourced language, such as Indonesian. We create a novel Indonesian Question Answering dataset that is produced automatically end-to-end. The process uses Context Free Grammar, the Wikipedia Indonesian Corpus, and the concept of the proxy model. The dataset consists of 134 thousand simple questions and 60 thousand complex questions. It achieved competitive grammatical and model accuracy compared to the translated dataset but suffers from some issues due to resource constraints.

Abstract Image

查看原文本刊更多论文

AC-IQuAD：利用维基数据自动构建印尼语问题解答数据集

构建一个问题解答数据集的成本过高，这使得研究人员很难为资源不足的语言（如印尼语）创建一个数据集。我们创建了一个端到端自动生成的新型印尼语答题数据集。该过程使用了上下文自由语法、维基百科印尼语语料库和代理模型概念。该数据集包括 13.4 万个简单问题和 6 万个复杂问题。与翻译过的数据集相比，该数据集的语法和模型准确率都很有竞争力，但由于资源限制，也存在一些问题。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Language Resources and Evaluation 工程技术-计算机：跨学科应用

CiteScore

6.50

自引率

3.70%

发文量

审稿时长

>12 weeks

期刊介绍： Language Resources and Evaluation is the first publication devoted to the acquisition, creation, annotation, and use of language resources, together with methods for evaluation of resources, technologies, and applications. Language resources include language data and descriptions in machine readable form used to assist and augment language processing applications, such as written or spoken corpora and lexica, multimodal resources, grammars, terminology or domain specific databases and dictionaries, ontologies, multimedia databases, etc., as well as basic software tools for their acquisition, preparation, annotation, management, customization, and use. Evaluation of language resources concerns assessing the state-of-the-art for a given technology, comparing different approaches to a given problem, assessing the availability of resources and technologies for a given application, benchmarking, and assessing system usability and user satisfaction.