Proceedings of the Workshop MultiLing 2019: Summarization Across Languages, Genres and Sources associated with RANLP 2019最新文献

The Summary Evaluation Task in the MultiLing - RANLP 2019 Workshop MultiLing - RANLP 2019研讨会总结评估任务

Proceedings of the Workshop MultiLing 2019: Summarization Across Languages, Genres and Sources associated with RANLP 2019 Pub Date : 2019-12-15 DOI: 10.26615/978-954-452-058-8_003

George Giannakopoulos, Greece SciFY Npc Greece Ncsr Demokritos, Nikiforos Pittaras, Greece Dit Nkua Ncsr Demokritos

{"title":"The Summary Evaluation Task in the MultiLing - RANLP 2019 Workshop","authors":"George Giannakopoulos, Greece SciFY Npc Greece Ncsr Demokritos, Nikiforos Pittaras, Greece Dit Nkua Ncsr Demokritos","doi":"10.26615/978-954-452-058-8_003","DOIUrl":"https://doi.org/10.26615/978-954-452-058-8_003","url":null,"abstract":"This report covers the summarization evaluation task, proposed to the summarization community via the MultiLing 2019 Workshop of the RANLP 2019 conference. The task aims to encourage the development of automatic summarization evaluation methods closely aligned with manual, human-authored summary grades and judgements. A multilingual setting is adopted, building upon a corpus of Wikinews articles across 6 languages (English, Arabic, Romanian, Greek, Spanish and Czech). The evaluation utilizes human (golden) and machine-generated (peer) summaries, which have been assigned human evaluation scores from previous MultiLing tasks. Using these resources, the original corpus is augmented with synthetic data, combining summary texts under three different strategies (reorder, merge and replace), each engineered to introduce noise in the summary in a controlled and quantifiable way. We estimate that the utilization of such data can extract and highlight useful attributes of summary quality estimation, aiding the creation of data-driven automatic methods with an increased correlation to human summary evaluations across domains and languages. This paper provides a brief description of the summary evaluation task, the data generation protocol and the resources made available by the MultiLing community, towards improving automatic summarization evaluation.","PeriodicalId":182255,"journal":{"name":"Proceedings of the Workshop MultiLing 2019: Summarization Across Languages, Genres and Sources associated with RANLP 2019","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116256322","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Social Web Observatory: An entity-driven, holistic information summarization platform across sources 社会网络观察站:一个实体驱动的、跨资源的整体信息总结平台

Proceedings of the Workshop MultiLing 2019: Summarization Across Languages, Genres and Sources associated with RANLP 2019 Pub Date : 2019-12-15 DOI: 10.26615/978-954-452-058-8_007

Leonidas Tsekouras, G. Petasis, Aris Kosmopoulos

引用次数: 1

MultiLing 2019: Financial Narrative Summarisation MultiLing 2019:财务叙事总结

Proceedings of the Workshop MultiLing 2019: Summarization Across Languages, Genres and Sources associated with RANLP 2019 Pub Date : 2019-12-15 DOI: 10.26615/978-954-452-058-8_002

Mahmoud El-Haj

引用次数: 18

RANLP 2019 Multilingual Headline Generation Task Overview RANLP 2019多语言标题生成任务概述

Proceedings of the Workshop MultiLing 2019: Summarization Across Languages, Genres and Sources associated with RANLP 2019 Pub Date : 2019-12-15 DOI: 10.26615/978-954-452-058-8_001

Marina Litvak, John M. Conroy, Peter A. Rankel, Ida

{"title":"RANLP 2019 Multilingual Headline Generation Task Overview","authors":"Marina Litvak, John M. Conroy, Peter A. Rankel, Ida","doi":"10.26615/978-954-452-058-8_001","DOIUrl":"https://doi.org/10.26615/978-954-452-058-8_001","url":null,"abstract":"The objective of the 2019 RANLP Multilingual Headline Generation (HG) Task is to explore some of the challenges highlighted by current state of the art approaches on creating informative headlines to news articles: non-descriptive headlines, out-of-domain training data, generating headlines from long documents which are not well represented by the head heuristic, and dealing with multilingual domain. This tasks makes available a large set of training data for headline generation and provides an evaluation methods for the task. Our data sets are drawn from Wikinews as well as Wikipedia. Participants were required to generate headlines for at least 3 languages, which were evaluated via automatic methods. A key aspect of the task is multilinguality. The task measures the performance of multilingual headline generation systems using the Wikipedia and Wikinews articles in multiple languages. The objective is to assess the performance of automatic headline generation techniques on text documents covering a diverse range of languages and topics outside the news domain.","PeriodicalId":182255,"journal":{"name":"Proceedings of the Workshop MultiLing 2019: Summarization Across Languages, Genres and Sources associated with RANLP 2019","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127015082","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

A study of semantic augmentation of word embeddings for extractive summarization 面向抽取摘要的词嵌入语义增强研究

Proceedings of the Workshop MultiLing 2019: Summarization Across Languages, Genres and Sources associated with RANLP 2019 Pub Date : 2019-12-15 DOI: 10.26615/978-954-452-058-8_009

Nikiforos Pittaras, V. Karkaletsis

引用次数: 1

Multi-lingual Wikipedia Summarization and Title Generation On Low Resource Corpus 基于低资源语料库的多语种维基百科摘要与标题生成

Proceedings of the Workshop MultiLing 2019: Summarization Across Languages, Genres and Sources associated with RANLP 2019 Pub Date : 2019-12-15 DOI: 10.26615/978-954-452-058-8_004

Wei Liu, Lei Li, Zuying Huang, Yinan Liu

引用次数: 5