Reliability vs. granularity in discourse annotation: What is the trade-off?

IF 1 2区文学 0 LANGUAGE & LINGUISTICS

Corpus Linguistics and Linguistic Theory Pub Date : 2019-05-27 DOI:10.1515/cllt-2016-0046

Ludivine Crible, Liesbeth Degand

引用次数: 30

Abstract

Abstract We report on the results of an annotation experiment comparing naïve and expert coders in a sense disambiguation task consisting in the assignment of function labels to discourse markers (e.g. well, but, I mean) in spoken French and English using a taxonomy specifically designed for speech. Our qualitative-quantitative assessment of its reliability led us to suggest fundamental revisions of the structure of the taxonomy, striving to find a better balance between reliability and granularity. The resulting model articulates two independent levels of annotation (domains and functions) which, once combined, provide a robust tool for the analysis of discourse markers and relate them to more general functions of spoken language.

查看原文本刊更多论文

话语注释的可靠性与粒度：权衡是什么？

摘要我们报告了一项注释实验的结果，该实验比较了在法语和英语口语中，使用专门为语音设计的分类法，将功能标签分配给话语标记（例如，好吧，但是，我的意思是）的意义消歧任务中的天真和专家编码者。我们对其可靠性的定性定量评估使我们建议对分类法的结构进行根本性的修改，努力在可靠性和粒度之间找到更好的平衡。由此产生的模型阐明了两个独立的注释层次（领域和功能），一旦结合起来，就为分析话语标记提供了一个强大的工具，并将它们与口语的更一般的功能联系起来。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Corpus Linguistics and Linguistic Theory Multiple-

CiteScore

4.20

自引率

12.50%

发文量

期刊介绍： Corpus Linguistics and Linguistic Theory (CLLT) is a peer-reviewed journal publishing high-quality original corpus-based research focusing on theoretically relevant issues in all core areas of linguistic research, or other recognized topic areas. It provides a forum for researchers from different theoretical backgrounds and different areas of interest that share a commitment to the systematic and exhaustive analysis of naturally occurring language. Contributions from all theoretical frameworks are welcome but they should be addressed at a general audience and thus be explicit about their assumptions and discovery procedures and provide sufficient theoretical background to be accessible to researchers from different frameworks. Topics Corpus Linguistics Quantitative Linguistics Phonology Morphology Semantics Syntax Pragmatics.