{"title":"用弹性词分析研究200多年来报纸的语言变化","authors":"Vincent Buntinx, Cyril Bornet, F. Kaplan","doi":"10.3389/fdigh.2017.00002","DOIUrl":null,"url":null,"abstract":"This paper presents a methodology to analyze linguistic changes in a given textual corpus allowing to overcome two common problems related to corpus linguistics studies. One of these issues is the monotonic increase of the corpus size with time and the other one is the presence of noise in the textual data. In addition, our method allows to better target the linguistic evolution of the corpus, instead of other aspects like noise fluctuation or topics evolution. A corpus formed by two newspapers, \"La Gazette de Lausanne\" and \"Le Journal de Gen\\`eve\", is used, providing 4 million articles from 200 years of archives. We first perform some classical measurements on this corpus in order to provide indicators and visualizations of linguistic evolution. We then define the concept of a lexical kernel and word resilience, to face the two challenges of noises and corpus size fluctuations. This paper ends with a discussion based on the comparison of results from linguistic change analysis and a concludes with possible future works continuing in that direction.","PeriodicalId":227954,"journal":{"name":"Frontiers Digit. Humanit.","volume":"23 2 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2017-02-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"12","resultStr":"{\"title\":\"Studying Linguistic Changes over 200 Years of Newspapers through Resilient Words Analysis\",\"authors\":\"Vincent Buntinx, Cyril Bornet, F. Kaplan\",\"doi\":\"10.3389/fdigh.2017.00002\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper presents a methodology to analyze linguistic changes in a given textual corpus allowing to overcome two common problems related to corpus linguistics studies. One of these issues is the monotonic increase of the corpus size with time and the other one is the presence of noise in the textual data. In addition, our method allows to better target the linguistic evolution of the corpus, instead of other aspects like noise fluctuation or topics evolution. A corpus formed by two newspapers, \\\"La Gazette de Lausanne\\\" and \\\"Le Journal de Gen\\\\`eve\\\", is used, providing 4 million articles from 200 years of archives. We first perform some classical measurements on this corpus in order to provide indicators and visualizations of linguistic evolution. We then define the concept of a lexical kernel and word resilience, to face the two challenges of noises and corpus size fluctuations. This paper ends with a discussion based on the comparison of results from linguistic change analysis and a concludes with possible future works continuing in that direction.\",\"PeriodicalId\":227954,\"journal\":{\"name\":\"Frontiers Digit. Humanit.\",\"volume\":\"23 2 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2017-02-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"12\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Frontiers Digit. Humanit.\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3389/fdigh.2017.00002\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers Digit. Humanit.","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3389/fdigh.2017.00002","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 12
摘要
本文提出了一种分析给定文本语料库中语言变化的方法,以克服语料库语言学研究中两个常见的问题。其中一个问题是语料库大小随时间的单调增长,另一个问题是文本数据中存在噪声。此外,我们的方法可以更好地针对语料库的语言演变,而不是其他方面,如噪声波动或主题演变。一个由两份报纸组成的语料库,“La Gazette de Lausanne”和“Le Journal de geneve”,从200年的档案中提供了400万篇文章。我们首先对语料库进行了一些经典测量,以提供语言演变的指标和可视化。然后,我们定义了词汇核和词弹性的概念,以面对噪声和语料库大小波动的两个挑战。本文最后对语言变化分析的结果进行了比较,并对今后可能继续进行的工作进行了总结。
Studying Linguistic Changes over 200 Years of Newspapers through Resilient Words Analysis
This paper presents a methodology to analyze linguistic changes in a given textual corpus allowing to overcome two common problems related to corpus linguistics studies. One of these issues is the monotonic increase of the corpus size with time and the other one is the presence of noise in the textual data. In addition, our method allows to better target the linguistic evolution of the corpus, instead of other aspects like noise fluctuation or topics evolution. A corpus formed by two newspapers, "La Gazette de Lausanne" and "Le Journal de Gen\`eve", is used, providing 4 million articles from 200 years of archives. We first perform some classical measurements on this corpus in order to provide indicators and visualizations of linguistic evolution. We then define the concept of a lexical kernel and word resilience, to face the two challenges of noises and corpus size fluctuations. This paper ends with a discussion based on the comparison of results from linguistic change analysis and a concludes with possible future works continuing in that direction.