文字塑造世界:文本驱动的图像和视频生成与生成对抗网络的综合探索

IF 6.5 2区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Mohd Nor Akmal Khalid , Anwar Ullah , Muhammad Numan , Abdul Majid
{"title":"文字塑造世界:文本驱动的图像和视频生成与生成对抗网络的综合探索","authors":"Mohd Nor Akmal Khalid ,&nbsp;Anwar Ullah ,&nbsp;Muhammad Numan ,&nbsp;Abdul Majid","doi":"10.1016/j.neucom.2025.129767","DOIUrl":null,"url":null,"abstract":"<div><div>A growing interest in education, media, and entertainment has increased Artificial Intelligence-powered content generation, mainly via Generative Adversarial Networks (GANs), which shape images, videos, audio, and text. A generative adversarial network (GAN) is the combination of two deep neural networks: generator (<span><math><mi>G</mi></math></span>) and discriminator (<span><math><mi>D</mi></math></span>). These two components are trained competitively by pitting one against the other such that <span><math><mi>G</mi></math></span> generates new data while <span><math><mi>D</mi></math></span> authenticates the data. By leveraging powerful deep neural networks and competitive training, GANs can synthesize reasonable and realistic images and videos from the text description. This paper extensively reviews the recent state-of-the-art GAN models for text-to-image (T2I) and text-to-video (T2V) synthesis. In this regard, databases like ACM, IEEE Explore, Web of Science, and ScienceDirect were searched to find and analyze the relevant research articles conducted in this area in the last decade, specifically from 2014 to 2024. Secondly, T2I and T2V GAN methods were classified according to structure and functionality. Later, a comprehensive evaluation between T2I and T2V GAN-based methods was conducted, employing various qualitative and quantitative evaluation techniques. Finally, the paper concludes by discussing multiple applications, main challenges, and limitations of T2I and T2V GAN models for future consideration.</div></div>","PeriodicalId":19268,"journal":{"name":"Neurocomputing","volume":"632 ","pages":"Article 129767"},"PeriodicalIF":6.5000,"publicationDate":"2025-02-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Words shaping worlds: A comprehensive exploration of text-driven image and video generation with generative adversarial networks\",\"authors\":\"Mohd Nor Akmal Khalid ,&nbsp;Anwar Ullah ,&nbsp;Muhammad Numan ,&nbsp;Abdul Majid\",\"doi\":\"10.1016/j.neucom.2025.129767\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>A growing interest in education, media, and entertainment has increased Artificial Intelligence-powered content generation, mainly via Generative Adversarial Networks (GANs), which shape images, videos, audio, and text. A generative adversarial network (GAN) is the combination of two deep neural networks: generator (<span><math><mi>G</mi></math></span>) and discriminator (<span><math><mi>D</mi></math></span>). These two components are trained competitively by pitting one against the other such that <span><math><mi>G</mi></math></span> generates new data while <span><math><mi>D</mi></math></span> authenticates the data. By leveraging powerful deep neural networks and competitive training, GANs can synthesize reasonable and realistic images and videos from the text description. This paper extensively reviews the recent state-of-the-art GAN models for text-to-image (T2I) and text-to-video (T2V) synthesis. In this regard, databases like ACM, IEEE Explore, Web of Science, and ScienceDirect were searched to find and analyze the relevant research articles conducted in this area in the last decade, specifically from 2014 to 2024. Secondly, T2I and T2V GAN methods were classified according to structure and functionality. Later, a comprehensive evaluation between T2I and T2V GAN-based methods was conducted, employing various qualitative and quantitative evaluation techniques. Finally, the paper concludes by discussing multiple applications, main challenges, and limitations of T2I and T2V GAN models for future consideration.</div></div>\",\"PeriodicalId\":19268,\"journal\":{\"name\":\"Neurocomputing\",\"volume\":\"632 \",\"pages\":\"Article 129767\"},\"PeriodicalIF\":6.5000,\"publicationDate\":\"2025-02-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Neurocomputing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0925231225004394\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurocomputing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0925231225004394","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

人们对教育、媒体和娱乐日益增长的兴趣增加了人工智能驱动的内容生成,主要是通过生成对抗网络(GANs)来生成图像、视频、音频和文本。生成对抗网络(GAN)是两个深度神经网络:生成器(G)和鉴别器(D)的组合。这两个组件通过相互竞争来训练,这样G生成新数据,而D验证数据。通过利用强大的深度神经网络和竞争性训练,gan可以从文本描述中合成合理逼真的图像和视频。本文广泛回顾了最新的文本到图像(T2I)和文本到视频(T2V)合成的GAN模型。为此,我们检索了ACM、IEEE Explore、Web of Science、ScienceDirect等数据库,查找并分析了近十年来,特别是2014年至2024年在该领域开展的相关研究文章。其次,根据结构和功能对T2I和T2V GAN方法进行分类。随后,采用各种定性和定量评估技术,对T2I和T2V基于gan的方法进行了综合评估。最后,本文最后讨论了T2I和T2V GAN模型的多种应用、主要挑战和局限性,以供将来考虑。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Words shaping worlds: A comprehensive exploration of text-driven image and video generation with generative adversarial networks
A growing interest in education, media, and entertainment has increased Artificial Intelligence-powered content generation, mainly via Generative Adversarial Networks (GANs), which shape images, videos, audio, and text. A generative adversarial network (GAN) is the combination of two deep neural networks: generator (G) and discriminator (D). These two components are trained competitively by pitting one against the other such that G generates new data while D authenticates the data. By leveraging powerful deep neural networks and competitive training, GANs can synthesize reasonable and realistic images and videos from the text description. This paper extensively reviews the recent state-of-the-art GAN models for text-to-image (T2I) and text-to-video (T2V) synthesis. In this regard, databases like ACM, IEEE Explore, Web of Science, and ScienceDirect were searched to find and analyze the relevant research articles conducted in this area in the last decade, specifically from 2014 to 2024. Secondly, T2I and T2V GAN methods were classified according to structure and functionality. Later, a comprehensive evaluation between T2I and T2V GAN-based methods was conducted, employing various qualitative and quantitative evaluation techniques. Finally, the paper concludes by discussing multiple applications, main challenges, and limitations of T2I and T2V GAN models for future consideration.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Neurocomputing
Neurocomputing 工程技术-计算机:人工智能
CiteScore
13.10
自引率
10.00%
发文量
1382
审稿时长
70 days
期刊介绍: Neurocomputing publishes articles describing recent fundamental contributions in the field of neurocomputing. Neurocomputing theory, practice and applications are the essential topics being covered.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信