Generative artificial intelligence-based modified abstractive cross attention enabled sequence to sequence model for abstractive Hindi text summarization
{"title":"Generative artificial intelligence-based modified abstractive cross attention enabled sequence to sequence model for abstractive Hindi text summarization","authors":"Babita Verma , Ani Thomas , Rohit Kumar Verma","doi":"10.1016/j.engappai.2025.111478","DOIUrl":null,"url":null,"abstract":"<div><div>Abstractive Text summarization is the process of providing a concise as well as cohesive summary, which encapsulates the vital information from the original text. Although the supervised models now in use are competent, they frequently rely on annotated datasets and create challenges regarding uninterpretability and limited generalization ability. To overcome the limitations, this research proposes a Generative Artificial Intelligence Sequence to sequence the Bidirectional Encoder Representations from the Transformers model to generate concise summaries. During the generation of the output sequence, the model takes into account data from various segments of the input sequence by utilizing a modified abstractive cross-attention technique. Specifically, the Generative Artificial Intelligence assists in removing grammatical mistakes in summaries via the application of the Global Surrogate method, which ensures the clarity and fluency of the output summary. In addition, the encoder-decoder model enables the accurate summary generation process, vastly improving fluency and accuracy. Furthermore, the experimental outcomes show that the Generative Artificial Intelligence Sequence to sequence the Bidirectional Encoder Representations from the Transformers model surpasses the conventional text summarization techniques concerning Bilingual Evaluation Understudy of 0.71 and Metric for Evaluation of Translation with Explicit Ordering of 0.73, which shows that the proposed model generates a meaningful summary from the given text.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"158 ","pages":"Article 111478"},"PeriodicalIF":7.5000,"publicationDate":"2025-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197625014800","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Abstractive Text summarization is the process of providing a concise as well as cohesive summary, which encapsulates the vital information from the original text. Although the supervised models now in use are competent, they frequently rely on annotated datasets and create challenges regarding uninterpretability and limited generalization ability. To overcome the limitations, this research proposes a Generative Artificial Intelligence Sequence to sequence the Bidirectional Encoder Representations from the Transformers model to generate concise summaries. During the generation of the output sequence, the model takes into account data from various segments of the input sequence by utilizing a modified abstractive cross-attention technique. Specifically, the Generative Artificial Intelligence assists in removing grammatical mistakes in summaries via the application of the Global Surrogate method, which ensures the clarity and fluency of the output summary. In addition, the encoder-decoder model enables the accurate summary generation process, vastly improving fluency and accuracy. Furthermore, the experimental outcomes show that the Generative Artificial Intelligence Sequence to sequence the Bidirectional Encoder Representations from the Transformers model surpasses the conventional text summarization techniques concerning Bilingual Evaluation Understudy of 0.71 and Metric for Evaluation of Translation with Explicit Ordering of 0.73, which shows that the proposed model generates a meaningful summary from the given text.
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.