ERE注释的注释者间协议

EVENTS@ACL Pub Date : 2014-06-01 DOI:10.3115/v1/W14-2904

S. Kulick, Ann Bies, Justin Mott

{"title":"ERE注释的注释者间协议","authors":"S. Kulick, Ann Bies, Justin Mott","doi":"10.3115/v1/W14-2904","DOIUrl":null,"url":null,"abstract":"This paper describes a system for interannotator agreement analysis of ERE annotation, focusing on entity mentions and how the higher-order annotations such as EVENTS are dependent on those entity mentions. The goal of this approach is to provide both (1) quantitative scores for the various levels of annotation, and (2) information about the types of annotation inconsistencies that might exist. While primarily designed for inter-annotator agreement, it can also be considered a system for evaluation of ERE annotation.","PeriodicalId":392223,"journal":{"name":"EVENTS@ACL","volume":"37 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2014-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"6","resultStr":"{\"title\":\"Inter-annotator Agreement for ERE annotation\",\"authors\":\"S. Kulick, Ann Bies, Justin Mott\",\"doi\":\"10.3115/v1/W14-2904\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper describes a system for interannotator agreement analysis of ERE annotation, focusing on entity mentions and how the higher-order annotations such as EVENTS are dependent on those entity mentions. The goal of this approach is to provide both (1) quantitative scores for the various levels of annotation, and (2) information about the types of annotation inconsistencies that might exist. While primarily designed for inter-annotator agreement, it can also be considered a system for evaluation of ERE annotation.\",\"PeriodicalId\":392223,\"journal\":{\"name\":\"EVENTS@ACL\",\"volume\":\"37 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2014-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"6\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"EVENTS@ACL\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3115/v1/W14-2904\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"EVENTS@ACL","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3115/v1/W14-2904","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 6

摘要

本文描述了一个用于ERE注释的注释者间协议分析系统，重点关注实体提及以及EVENTS等高阶注释如何依赖于这些实体提及。这种方法的目标是提供(1)不同级别注释的定量分数，以及(2)可能存在的注释不一致类型的信息。虽然主要是为注释者之间的协议而设计的，但它也可以被认为是一个评估ERE注释的系统。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Inter-annotator Agreement for ERE annotation

This paper describes a system for interannotator agreement analysis of ERE annotation, focusing on entity mentions and how the higher-order annotations such as EVENTS are dependent on those entity mentions. The goal of this approach is to provide both (1) quantitative scores for the various levels of annotation, and (2) information about the types of annotation inconsistencies that might exist. While primarily designed for inter-annotator agreement, it can also be considered a system for evaluation of ERE annotation.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

EVENTS@ACL

自引率

0.00%

发文量