Message Understanding Conference最新文献

筛选
英文 中文
Statistical Significance of MUC-6 Results muc6结果的统计学意义
Message Understanding Conference Pub Date : 1995-11-06 DOI: 10.3115/1072399.1072404
Nancy A. Chinchor
{"title":"Statistical Significance of MUC-6 Results","authors":"Nancy A. Chinchor","doi":"10.3115/1072399.1072404","DOIUrl":"https://doi.org/10.3115/1072399.1072404","url":null,"abstract":"The results of the MUC-6 evaluation must be analyzed to determine whether close scores significantly distinguish systems or whether the differences in those scores are a matter of chance. In order to do such an analysis, a method of computer intensive hypothesis testing was developed by SAIC for the MUC-3 results and has been used for distinguishing MUC scores since that time. The implementation of this method for the MUC evaluations was first described in [1] and later the concepts behind the statistical model were explained in a more understandable manner in [2]. This paper gives the results of the statistical testing for the three MUC-6 tasks where a single metric could be associated with a system's performance.","PeriodicalId":424990,"journal":{"name":"Message Understanding Conference","volume":"66 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1995-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128748706","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 29
Sterling software: an NLToolset-based system for MUC-6 Sterling软件:基于nltoolset的MUC-6系统
Message Understanding Conference Pub Date : 1995-11-06 DOI: 10.3115/1072399.1072421
Richard Lee
{"title":"Sterling software: an NLToolset-based system for MUC-6","authors":"Richard Lee","doi":"10.3115/1072399.1072421","DOIUrl":"https://doi.org/10.3115/1072399.1072421","url":null,"abstract":"For a little over two years, Sterling Software ITD has been developing the Automatic Templating System (ATS) [1] for automatically extracting entity and event data in the counter-narcotics domain from military messages. This system, part of the Counter Drug Intelligence System (CDIS), was built around the NLToolset [2], which was originally developed by GE and is now being developed and supported by Lockheed-Martin. Early results showed that the system was performing better than the human analysts in all aspects.","PeriodicalId":424990,"journal":{"name":"Message Understanding Conference","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1995-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122532965","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
CRL/NMSU: description of the CRL/NMSU systems used for MUC-6 CRL/NMSU: MUC-6使用的CRL/NMSU系统说明
Message Understanding Conference Pub Date : 1995-11-06 DOI: 10.3115/1072399.1072414
J. Cowie
{"title":"CRL/NMSU: description of the CRL/NMSU systems used for MUC-6","authors":"J. Cowie","doi":"10.3115/1072399.1072414","DOIUrl":"https://doi.org/10.3115/1072399.1072414","url":null,"abstract":"This paper discusses the two CRL named entity recognition systems submitted for MUC-6. The systems are based on entirely different approaches. The first is a data intensive method, which uses human generated patterns. The second uses the training data to develop decision trees which detect the start and end points of names.","PeriodicalId":424990,"journal":{"name":"Message Understanding Conference","volume":"72 3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1995-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123265232","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 12
A Model-Theoretic Coreference Scoring Scheme 一种模型理论的共同参考评分方案
Message Understanding Conference Pub Date : 1995-11-06 DOI: 10.3115/1072399.1072405
M. Vilain, J. Burger, J. Aberdeen, D. Connolly, L. Hirschman
{"title":"A Model-Theoretic Coreference Scoring Scheme","authors":"M. Vilain, J. Burger, J. Aberdeen, D. Connolly, L. Hirschman","doi":"10.3115/1072399.1072405","DOIUrl":"https://doi.org/10.3115/1072399.1072405","url":null,"abstract":"This note describes a scoring scheme for the coreference task in MUC6. It improves on the original approach by: (1) grounding the scoring scheme in terms of a model; (2) producing more intuitive recall and precision scores; and (3) not requiring explicit computation of the transitive closure of coreference. The principal conceptual difference is that we have moved from a syntactic scoring model based on following coreference links to an approach defined by the model theory of those links.","PeriodicalId":424990,"journal":{"name":"Message Understanding Conference","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1995-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128200262","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 817
SRA: description of the SRA system as used for MUC-6 SRA:描述用于MUC-6的SRA系统
Message Understanding Conference Pub Date : 1995-11-06 DOI: 10.3115/1072399.1072419
George R. Krupka
{"title":"SRA: description of the SRA system as used for MUC-6","authors":"George R. Krupka","doi":"10.3115/1072399.1072419","DOIUrl":"https://doi.org/10.3115/1072399.1072419","url":null,"abstract":"SRA used the combination of two systems for the MUC-6 tasks: NameTag™, a commercial software product that recognizes proper names and other key phrases in text; and HASTEN, an experimental text extraction system that has been under development for only one year. For the Named Entity task, SRA adapted a subset of NameTag's capabilities to the MUC-6 specification. For the Template Element task, SRA fed the full results of NameTag into HASTEN, which performed additional processing to extract and generate the organization and person templates. For the Scenario Template task, SRA fed NameTag's results into HASTEN, which used its full extraction capabilities to extract and generate the management succession templates. Figure 1 illustrates the contribution of each system to the MUC-6 tasks. Due to the relative complexity of the scenario template task, this paper will focus on HASTEN and the experimental results for scenario extraction, and will provide brief descriptions of NameTag and the other tasks.","PeriodicalId":424990,"journal":{"name":"Message Understanding Conference","volume":"940 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1995-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116429692","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 98
University of Sheffield: Description of the LaSIE System as Used for MUC-6 谢菲尔德大学:用于muc6的LaSIE系统描述
Message Understanding Conference Pub Date : 1995-11-06 DOI: 10.3115/1072399.1072418
R. Gaizauskas, K. Humphreys, H. Cunningham, Y. Wilks
{"title":"University of Sheffield: Description of the LaSIE System as Used for MUC-6","authors":"R. Gaizauskas, K. Humphreys, H. Cunningham, Y. Wilks","doi":"10.3115/1072399.1072418","DOIUrl":"https://doi.org/10.3115/1072399.1072418","url":null,"abstract":"The LaSIE (Large Scale Information Extraction) system has been developed at the University of Sheffield as part of an ongoing research effort into information extraction and, more generally, natural language engineering.","PeriodicalId":424990,"journal":{"name":"Message Understanding Conference","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1995-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122299539","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 237
SRI International FASTUS SystemMUC-6 Test Results and Analysis SRI国际FASTUS系统muc -6测试结果和分析
Message Understanding Conference Pub Date : 1995-11-06 DOI: 10.3115/1072399.1072420
D. Appelt, Jerry R. Hobbs, J. Bear, David J. Israel, M. Kameyama, David L. Martin, Karen L. Myers, M. Tyson
{"title":"SRI International FASTUS SystemMUC-6 Test Results and Analysis","authors":"D. Appelt, Jerry R. Hobbs, J. Bear, David J. Israel, M. Kameyama, David L. Martin, Karen L. Myers, M. Tyson","doi":"10.3115/1072399.1072420","DOIUrl":"https://doi.org/10.3115/1072399.1072420","url":null,"abstract":"SRI International participated in the MUC-6 evaluation using the latest version of SRI's FASTUS system [1]. The FASTUS system was originally developed for participation in the MUC-4 evaluation [3] in 1992, and the performance of FASTUS in MUC-4 helped demonstrate the viability of finite state technologies in constrained natural-language understanding tasks. The system has undergone significant revision since MUC-4, and it is safe to say that the current system does not share a single line of code with the original. The fundamental ideas behind FASTUS, however, are retained in the current system: an architecture consisting of cascaded finite state transducers, each providing an additional level of analysis of the input, together with merging of the final results.","PeriodicalId":424990,"journal":{"name":"Message Understanding Conference","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1995-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134002032","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 170
University of Manitoba: Description of the PIE System Used for MUC-6 曼尼托巴大学:用于mu -6的PIE系统描述
Message Understanding Conference Pub Date : 1995-11-06 DOI: 10.3115/1072399.1072411
Dekang Lin
{"title":"University of Manitoba: Description of the PIE System Used for MUC-6","authors":"Dekang Lin","doi":"10.3115/1072399.1072411","DOIUrl":"https://doi.org/10.3115/1072399.1072411","url":null,"abstract":"The PIE (Principar-driven Information Extraction) system takes a different approach to the problem of information extraction from the NUBA system that was used in MUC-5. The NUBA system did not have a parser and relies on an abductive reasoner to construct the semantic relationships between domain specific concepts mentioned in a sentence. The PIE system, on the other hand, relies heavily on a principle-based broad-coverage parser, called PRINCIPAR [2, 6, 8], that we have developed over the past three years. Most of the information extracted are directly \"read-off\" the parser outputs by a subtree pattern-matcher, bypassing the usual step of constructing semantic representations.","PeriodicalId":424990,"journal":{"name":"Message Understanding Conference","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1995-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114434067","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 20
MITRE: description of the Alembic system used for MUC-6 MITRE:用于MUC-6的Alembic系统的描述
Message Understanding Conference Pub Date : 1995-11-06 DOI: 10.3115/1072399.1072413
J. Aberdeen, J. Burger, David S. Day, L. Hirschman, Patricia Robinson, M. Vilain
{"title":"MITRE: description of the Alembic system used for MUC-6","authors":"J. Aberdeen, J. Burger, David S. Day, L. Hirschman, Patricia Robinson, M. Vilain","doi":"10.3115/1072399.1072413","DOIUrl":"https://doi.org/10.3115/1072399.1072413","url":null,"abstract":"As with several other veteran MUC participants, MITRE's Alembic system has undergone a major transformation in the past two years. The genesis of this transformation occurred during a dinner conversation at the last MUC conference, MUC-5. At that time, several of us reluctantly admitted that our major impediment towards improved performance was reliance on then-standard linguistic models of syntax. We knew we would need an alternative to traditional linguistic grammars, even to the somewhat non-traditional categorial pseudo-parser we had in place at the time. The problem was, which alternative?","PeriodicalId":424990,"journal":{"name":"Message Understanding Conference","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1995-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126342168","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 190
Description of the SAIC DX system as used for MUC-6 描述用于MUC-6的SAIC DX系统
Message Understanding Conference Pub Date : 1995-11-06 DOI: 10.3115/1072399.1072417
L. A. Miller
{"title":"Description of the SAIC DX system as used for MUC-6","authors":"L. A. Miller","doi":"10.3115/1072399.1072417","DOIUrl":"https://doi.org/10.3115/1072399.1072417","url":null,"abstract":"This is a very young project, operational for only a few months. The focus of the effort is data-extraction, the identification of instances of data-classes in \"commercial\" text -- e.g., newspapers, technical reports, business correspondence, intelligence briefs. Instances of data-classes in text are phrases which identify factual content, such as names of people or organizations, products, financial amounts, quantities, and so forth.","PeriodicalId":424990,"journal":{"name":"Message Understanding Conference","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1995-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114244000","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信