EASESUM: an online abstractive and extractive text summarizer using deep learning technique

Jide Kehinde Adeniyi, S. A. Ajagbe, A. Adeniyi, H. Aworinde, P. Falola, M. Adigun
{"title":"EASESUM: an online abstractive and extractive text summarizer using deep learning technique","authors":"Jide Kehinde Adeniyi, S. A. Ajagbe, A. Adeniyi, H. Aworinde, P. Falola, M. Adigun","doi":"10.11591/ijai.v13.i2.pp1888-1899","DOIUrl":null,"url":null,"abstract":"<div align=\"center\"><table width=\"590\" border=\"1\" cellspacing=\"0\" cellpadding=\"0\"><tbody><tr><td valign=\"top\" width=\"387\"><p class=\"CM12\">Large volumes of information are generated daily, making it challenging to manage such information. This is due to redundancy and the type of data available, most of which needs to be more structured and increases the amount of search time. Text summarization systems are considered a real solution to this vast amount of data because they are used for document compression and reduction. Text summarization keeps the relevant information and eliminates the text's non-relevant parts. This study uses two types of summarizers: Extractive Text summarizers and Abstractive text summarizers. The Text Rank Algorithm was used to implement the Extractive summarizer, while Bi-directional Recurrent Neural Network (RNN) was used to implement the Abstractive text summarizer. To improve the quality of summaries produced, word embedding was also used. For the evaluation of the summarizers, the ROUGE evaluation system was used. ROUGE contrasts summaries created by hand versus those created automatically. ROUGE examination of the produced summary revealed the superiority of human-produced summaries over those generated automatically. For this paper, a summarizer was implemented as a Web Application. The average ROUGE recall score ranging from 30.00 to 60.00 for abstractive summarizer and 0.75 to 0.82 for extractive text showed an encouraging result.</p></td></tr></tbody></table></div>","PeriodicalId":507934,"journal":{"name":"IAES International Journal of Artificial Intelligence (IJ-AI)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IAES International Journal of Artificial Intelligence (IJ-AI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.11591/ijai.v13.i2.pp1888-1899","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Large volumes of information are generated daily, making it challenging to manage such information. This is due to redundancy and the type of data available, most of which needs to be more structured and increases the amount of search time. Text summarization systems are considered a real solution to this vast amount of data because they are used for document compression and reduction. Text summarization keeps the relevant information and eliminates the text's non-relevant parts. This study uses two types of summarizers: Extractive Text summarizers and Abstractive text summarizers. The Text Rank Algorithm was used to implement the Extractive summarizer, while Bi-directional Recurrent Neural Network (RNN) was used to implement the Abstractive text summarizer. To improve the quality of summaries produced, word embedding was also used. For the evaluation of the summarizers, the ROUGE evaluation system was used. ROUGE contrasts summaries created by hand versus those created automatically. ROUGE examination of the produced summary revealed the superiority of human-produced summaries over those generated automatically. For this paper, a summarizer was implemented as a Web Application. The average ROUGE recall score ranging from 30.00 to 60.00 for abstractive summarizer and 0.75 to 0.82 for extractive text showed an encouraging result.

EASESUM:使用深度学习技术的在线抽象和提取文本摘要器
每天都会产生大量信息,因此管理这些信息具有挑战性。这是由于冗余和可用数据类型造成的,其中大部分数据需要更加结构化,并增加了搜索时间。文本摘要系统可用于压缩和减少文档,因此被认为是解决海量数据的真正方法。文本摘要保留了相关信息,剔除了文本中的无关部分。本研究使用两种类型的摘要器:提取式文本摘要器和抽象式文本摘要器。提取式文本摘要器采用文本排序算法,抽象式文本摘要器采用双向循环神经网络(RNN)。为了提高摘要的质量,还使用了词嵌入技术。在对摘要器进行评估时,使用了 ROUGE 评估系统。ROUGE 将手工创建的摘要与自动创建的摘要进行对比。ROUGE 对所生成摘要的检查显示,人工生成的摘要优于自动生成的摘要。本文将摘要器作为网络应用程序实施。抽象摘要的平均 ROUGE 召回分数从 30.00 到 60.00 不等,提取文本的平均 ROUGE 召回分数从 0.75 到 0.82 不等,结果令人鼓舞。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信