NLP中用于问答和机器阅读理解的深度学习方法综述

R. R., Gnanapriya B, J. J. S.
{"title":"NLP中用于问答和机器阅读理解的深度学习方法综述","authors":"R. R., Gnanapriya B, J. J. S.","doi":"10.1109/DELCON57910.2023.10127327","DOIUrl":null,"url":null,"abstract":"Natural Language Processing (NLP) deals with the development of methodologies capable of interacting with computer through human language. NLP improves machine’s comprehension of human language, allowing for human-computer communication based on linguistics. Recent years have seen phenomenal success of NLP models in language and grammatical tasks such as information extraction, translation, classification and reasoning. This accomplishment is mainly due to the influence of transformers, which inspired design ideas such as BERT, SQuAD 2.0 and others. These large-scale models produced unique results, despite the higher computational cost. As a result, current NLP systems use transfer learning, pruning, knowledge filtration and quantization to accomplish reasonable performance. Furthermore, Information Retrievers (IR) are created to extract precise data files from large datasets, addressing the large data assertion made by language models. Major contribution of this study is to understand the application of deep learning methods in NLP for automated question answering and obtaining a comprehension of essay text. Context-based NLP issues that are presented along with existing solutions. The challenges of using NLP in comprehension are examined, as well as research community methods for extracting answers from paragraphs. Further direction of this research is to develop novel deep learning models for QA and text comprehension that can overcome the demerits of existing approaches.","PeriodicalId":193577,"journal":{"name":"2023 2nd Edition of IEEE Delhi Section Flagship Conference (DELCON)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Comprehensive Review on Deep Learning Approaches for Question Answering and Machine Reading Comprehension in NLP\",\"authors\":\"R. R., Gnanapriya B, J. J. S.\",\"doi\":\"10.1109/DELCON57910.2023.10127327\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Natural Language Processing (NLP) deals with the development of methodologies capable of interacting with computer through human language. NLP improves machine’s comprehension of human language, allowing for human-computer communication based on linguistics. Recent years have seen phenomenal success of NLP models in language and grammatical tasks such as information extraction, translation, classification and reasoning. This accomplishment is mainly due to the influence of transformers, which inspired design ideas such as BERT, SQuAD 2.0 and others. These large-scale models produced unique results, despite the higher computational cost. As a result, current NLP systems use transfer learning, pruning, knowledge filtration and quantization to accomplish reasonable performance. Furthermore, Information Retrievers (IR) are created to extract precise data files from large datasets, addressing the large data assertion made by language models. Major contribution of this study is to understand the application of deep learning methods in NLP for automated question answering and obtaining a comprehension of essay text. Context-based NLP issues that are presented along with existing solutions. The challenges of using NLP in comprehension are examined, as well as research community methods for extracting answers from paragraphs. Further direction of this research is to develop novel deep learning models for QA and text comprehension that can overcome the demerits of existing approaches.\",\"PeriodicalId\":193577,\"journal\":{\"name\":\"2023 2nd Edition of IEEE Delhi Section Flagship Conference (DELCON)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-02-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 2nd Edition of IEEE Delhi Section Flagship Conference (DELCON)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/DELCON57910.2023.10127327\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 2nd Edition of IEEE Delhi Section Flagship Conference (DELCON)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/DELCON57910.2023.10127327","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

自然语言处理(NLP)涉及能够通过人类语言与计算机交互的方法的发展。NLP提高了机器对人类语言的理解能力,允许基于语言学的人机交流。近年来,NLP模型在语言和语法任务(如信息提取、翻译、分类和推理)中取得了惊人的成功。这一成就主要得益于变形金刚的影响,它启发了BERT、SQuAD 2.0等设计理念。这些大规模模型产生了独特的结果,尽管计算成本较高。因此,目前的NLP系统使用迁移学习、剪枝、知识过滤和量化来实现合理的性能。此外,还创建了信息检索器(Information retrieval, IR)来从大型数据集中提取精确的数据文件,以解决语言模型做出的大数据断言。本研究的主要贡献是了解深度学习方法在NLP中的应用,用于自动问答和获得对短文文本的理解。与现有解决方案一起提出的基于上下文的NLP问题。研究了在理解中使用NLP的挑战,以及从段落中提取答案的研究社区方法。本研究的进一步方向是为QA和文本理解开发新的深度学习模型,以克服现有方法的缺点。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A Comprehensive Review on Deep Learning Approaches for Question Answering and Machine Reading Comprehension in NLP
Natural Language Processing (NLP) deals with the development of methodologies capable of interacting with computer through human language. NLP improves machine’s comprehension of human language, allowing for human-computer communication based on linguistics. Recent years have seen phenomenal success of NLP models in language and grammatical tasks such as information extraction, translation, classification and reasoning. This accomplishment is mainly due to the influence of transformers, which inspired design ideas such as BERT, SQuAD 2.0 and others. These large-scale models produced unique results, despite the higher computational cost. As a result, current NLP systems use transfer learning, pruning, knowledge filtration and quantization to accomplish reasonable performance. Furthermore, Information Retrievers (IR) are created to extract precise data files from large datasets, addressing the large data assertion made by language models. Major contribution of this study is to understand the application of deep learning methods in NLP for automated question answering and obtaining a comprehension of essay text. Context-based NLP issues that are presented along with existing solutions. The challenges of using NLP in comprehension are examined, as well as research community methods for extracting answers from paragraphs. Further direction of this research is to develop novel deep learning models for QA and text comprehension that can overcome the demerits of existing approaches.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信