评估单词的通用性

IF 1.6 2区文学 0 LANGUAGE & LINGUISTICS

International Journal of Corpus Linguistics Pub Date : 2022-11-25 DOI:10.1075/ijcl.21037.eke

Mikkel Ekeland Paulsen

{"title":"评估单词的通用性","authors":"Mikkel Ekeland Paulsen","doi":"10.1075/ijcl.21037.eke","DOIUrl":null,"url":null,"abstract":"\n The article investigates the two main corpus indicators of word commonness, frequency and dispersion, through a\n cross-validation analysis of frequency and four dispersion measures (‘Range’, ‘Chi-squared’, ‘Deviation of Proportions’ and\n ‘Juilland’s D’). The approach provides an estimation of the capacity of the named measures to predict the distribution of corpus\n items in an extracted language sample. Based on a dataset of 273 Norwegian compounds, the results show that especially Deviation\n of Proportions is a robust measure of dispersion that can be used in conjunction with frequency to substantiate assertions of word\n commonness based on corpus data. In addition, dispersion measures do not only reflect what sort of distribution the frequency\n statistic is generated from, but also how reliable the frequency estimation in the corpus sample is in terms of giving an accurate\n representation of frequency in the language variety that the corpus is sampled from.","PeriodicalId":46843,"journal":{"name":"International Journal of Corpus Linguistics","volume":null,"pages":null},"PeriodicalIF":1.6000,"publicationDate":"2022-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Assessing word commonness\",\"authors\":\"Mikkel Ekeland Paulsen\",\"doi\":\"10.1075/ijcl.21037.eke\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"\\n The article investigates the two main corpus indicators of word commonness, frequency and dispersion, through a\\n cross-validation analysis of frequency and four dispersion measures (‘Range’, ‘Chi-squared’, ‘Deviation of Proportions’ and\\n ‘Juilland’s D’). The approach provides an estimation of the capacity of the named measures to predict the distribution of corpus\\n items in an extracted language sample. Based on a dataset of 273 Norwegian compounds, the results show that especially Deviation\\n of Proportions is a robust measure of dispersion that can be used in conjunction with frequency to substantiate assertions of word\\n commonness based on corpus data. In addition, dispersion measures do not only reflect what sort of distribution the frequency\\n statistic is generated from, but also how reliable the frequency estimation in the corpus sample is in terms of giving an accurate\\n representation of frequency in the language variety that the corpus is sampled from.\",\"PeriodicalId\":46843,\"journal\":{\"name\":\"International Journal of Corpus Linguistics\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.6000,\"publicationDate\":\"2022-11-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Corpus Linguistics\",\"FirstCategoryId\":\"98\",\"ListUrlMain\":\"https://doi.org/10.1075/ijcl.21037.eke\",\"RegionNum\":2,\"RegionCategory\":\"文学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"0\",\"JCRName\":\"LANGUAGE & LINGUISTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Corpus Linguistics","FirstCategoryId":"98","ListUrlMain":"https://doi.org/10.1075/ijcl.21037.eke","RegionNum":2,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"0","JCRName":"LANGUAGE & LINGUISTICS","Score":null,"Total":0}

引用次数: 0

摘要

本文通过对词频和四个离散度度量(“范围”、“卡方”、“比例偏差”和“茱莉兰D”)的交叉验证分析，考察了词的共性、频率和离散度这两个主要语料库指标。该方法提供了命名度量在提取的语言样本中预测语料库项目分布的能力的估计。基于273个挪威语复合词的数据集，结果表明，比例偏差(Deviation of Proportions)是一种鲁棒的离散度量，可以与频率一起使用，以证实基于语料库数据的词共同性断言。此外，离散度量不仅反映了频率统计是从哪种分布生成的，而且还反映了语料库样本中频率估计的可靠性，因为语料库样本给出了语料库样本中语言种类频率的准确表示。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Assessing word commonness

The article investigates the two main corpus indicators of word commonness, frequency and dispersion, through a cross-validation analysis of frequency and four dispersion measures (‘Range’, ‘Chi-squared’, ‘Deviation of Proportions’ and ‘Juilland’s D’). The approach provides an estimation of the capacity of the named measures to predict the distribution of corpus items in an extracted language sample. Based on a dataset of 273 Norwegian compounds, the results show that especially Deviation of Proportions is a robust measure of dispersion that can be used in conjunction with frequency to substantiate assertions of word commonness based on corpus data. In addition, dispersion measures do not only reflect what sort of distribution the frequency statistic is generated from, but also how reliable the frequency estimation in the corpus sample is in terms of giving an accurate representation of frequency in the language variety that the corpus is sampled from.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

International Journal of Corpus Linguistics Multiple-

CiteScore

3.30

自引率

0.00%

发文量

期刊介绍： The International Journal of Corpus Linguistics (IJCL) publishes original research covering methodological, applied and theoretical work in any area of corpus linguistics. Through its focus on empirical language research, IJCL provides a forum for the presentation of new findings and innovative approaches in any area of linguistics (e.g. lexicology, grammar, discourse analysis, stylistics, sociolinguistics, morphology, contrastive linguistics), applied linguistics (e.g. language teaching, forensic linguistics), and translation studies. Based on its interest in corpus methodology, IJCL also invites contributions on the interface between corpus and computational linguistics.