缅甸新闻标题生成序列到序列模型

Yamin Thu, Win Pa Pa
{"title":"缅甸新闻标题生成序列到序列模型","authors":"Yamin Thu, Win Pa Pa","doi":"10.1109/O-COCOSDA50338.2020.9295017","DOIUrl":null,"url":null,"abstract":"News Headline generation is one of the most valuable research recently in NLP area. Generation of News headline means by learning to map articles to headlines using Sequence-to-Sequence model. Headline Generator that used an encoder and a decoder designed using Long Short-Term Memory (LSTM) was applied in this work. In this paper, an automatic headline generation for Myanmar News article using Seq2Seq model is implemented. There are various ways to generate a headline for news. In this paper, headline was generated using Seq2Seq with one-hot encoding and described about the comparative analysis results. While constructing the model, there are some challenges such as vocabulary counting and find out unknown terms in word embedding. In order to get more meaningful results, used the error analysis to typical neural headline generation system and evaluated based on machine generated headlines and actual headlines using ROUGE evaluation metric. The experiments have been conducted on Myanmar News dataset of 7000 pairs of news articles and their corresponding headlines. According to the evaluation, Seq2Seq with one-hot encoding outperforms than other Seq2Seq with word embedding (GloVe) and Recursive Recurrent Neural Network (Recursive RNN).","PeriodicalId":385266,"journal":{"name":"2020 23rd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques (O-COCOSDA)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"Myanmar News Headline Generation with Sequence-to-Sequence model\",\"authors\":\"Yamin Thu, Win Pa Pa\",\"doi\":\"10.1109/O-COCOSDA50338.2020.9295017\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"News Headline generation is one of the most valuable research recently in NLP area. Generation of News headline means by learning to map articles to headlines using Sequence-to-Sequence model. Headline Generator that used an encoder and a decoder designed using Long Short-Term Memory (LSTM) was applied in this work. In this paper, an automatic headline generation for Myanmar News article using Seq2Seq model is implemented. There are various ways to generate a headline for news. In this paper, headline was generated using Seq2Seq with one-hot encoding and described about the comparative analysis results. While constructing the model, there are some challenges such as vocabulary counting and find out unknown terms in word embedding. In order to get more meaningful results, used the error analysis to typical neural headline generation system and evaluated based on machine generated headlines and actual headlines using ROUGE evaluation metric. The experiments have been conducted on Myanmar News dataset of 7000 pairs of news articles and their corresponding headlines. According to the evaluation, Seq2Seq with one-hot encoding outperforms than other Seq2Seq with word embedding (GloVe) and Recursive Recurrent Neural Network (Recursive RNN).\",\"PeriodicalId\":385266,\"journal\":{\"name\":\"2020 23rd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques (O-COCOSDA)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-11-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 23rd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques (O-COCOSDA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/O-COCOSDA50338.2020.9295017\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 23rd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques (O-COCOSDA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/O-COCOSDA50338.2020.9295017","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 3

摘要

新闻标题生成是近年来NLP领域最有价值的研究之一。新闻标题的生成是指学习使用序列到序列模型将文章映射到标题。标题发生器采用长短期记忆(LSTM)设计的编码器和解码器。本文采用Seq2Seq模型实现了缅甸新闻文章标题的自动生成。有各种各样的方法可以产生新闻标题。本文使用单热编码的Seq2Seq生成标题,并描述了对比分析结果。在构建模型的过程中,存在词汇计数和词嵌入中未知词的发现等问题。为了得到更有意义的结果,对典型的神经标题生成系统进行误差分析,使用ROUGE评价指标对机器生成的标题和实际标题进行评价。实验在缅甸新闻的7000对新闻文章及其标题数据集上进行。根据评价,单热编码的Seq2Seq优于其他采用词嵌入(GloVe)和递归递归神经网络(Recursive Recurrent Neural Network, RNN)的Seq2Seq。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Myanmar News Headline Generation with Sequence-to-Sequence model
News Headline generation is one of the most valuable research recently in NLP area. Generation of News headline means by learning to map articles to headlines using Sequence-to-Sequence model. Headline Generator that used an encoder and a decoder designed using Long Short-Term Memory (LSTM) was applied in this work. In this paper, an automatic headline generation for Myanmar News article using Seq2Seq model is implemented. There are various ways to generate a headline for news. In this paper, headline was generated using Seq2Seq with one-hot encoding and described about the comparative analysis results. While constructing the model, there are some challenges such as vocabulary counting and find out unknown terms in word embedding. In order to get more meaningful results, used the error analysis to typical neural headline generation system and evaluated based on machine generated headlines and actual headlines using ROUGE evaluation metric. The experiments have been conducted on Myanmar News dataset of 7000 pairs of news articles and their corresponding headlines. According to the evaluation, Seq2Seq with one-hot encoding outperforms than other Seq2Seq with word embedding (GloVe) and Recursive Recurrent Neural Network (Recursive RNN).
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信