NWJC2Vec

IF 0.9 4区文学 0 LANGUAGE & LINGUISTICS

Terminology Pub Date : 2018-05-31 DOI:10.1075/term.00011.asa

Masayuki Asahara

引用次数: 1

Abstract

In this paper, we present a word embedding dataset NWJC2Vec constructed using ‘NINJAL Web Japanese Corpus (NWJC)’. NWJC is a Web-crawled text corpus that contains 25.8 billion tokens. We construct two types of the word embedding dataset: one is based on the surface form, and the other is based on the complete morpheme information provided by UniDic, which is a lexicon for the Japanese morphological analyser MeCab. We perform an evaluation of the dataset by comparing it with the ‘Word List by Semantic Principles (Bunrui Goihyo)’.

查看原文本刊更多论文

NWJC2Vec

在本文中，我们提出了一个使用“NINJAL Web日语语料库(NWJC)”构建的词嵌入数据集NWJC2Vec。NWJC是一个网络抓取的文本语料库，包含258亿个令牌。我们构建了两种类型的词嵌入数据集:一种是基于表面形式，另一种是基于UniDic提供的完整语素信息，UniDic是日语词素分析器MeCab的词典。我们通过将数据集与“基于语义原则的词表(Bunrui Goihyo)”进行比较来对数据集进行评估。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Terminology Multiple-

CiteScore

1.60

自引率

0.00%

发文量

期刊介绍： Terminology is an independent journal with a cross-cultural and cross-disciplinary scope. It focusses on the discussion of (systematic) solutions not only of language problems encountered in translation, but also, for example, of (monolingual) problems of ambiguity, reference and developments in multidisciplinary communication. Particular attention will be given to new and developing subject areas such as knowledge representation and transfer, information technology tools, expert systems and terminological databases. Terminology encompasses terminology both in general (theory and practice) and in specialized fields (LSP), such as physics.