Mohd Nor Akmal Khalid , Anwar Ullah , Muhammad Numan , Abdul Majid
{"title":"文字塑造世界:文本驱动的图像和视频生成与生成对抗网络的综合探索","authors":"Mohd Nor Akmal Khalid , Anwar Ullah , Muhammad Numan , Abdul Majid","doi":"10.1016/j.neucom.2025.129767","DOIUrl":null,"url":null,"abstract":"<div><div>A growing interest in education, media, and entertainment has increased Artificial Intelligence-powered content generation, mainly via Generative Adversarial Networks (GANs), which shape images, videos, audio, and text. A generative adversarial network (GAN) is the combination of two deep neural networks: generator (<span><math><mi>G</mi></math></span>) and discriminator (<span><math><mi>D</mi></math></span>). These two components are trained competitively by pitting one against the other such that <span><math><mi>G</mi></math></span> generates new data while <span><math><mi>D</mi></math></span> authenticates the data. By leveraging powerful deep neural networks and competitive training, GANs can synthesize reasonable and realistic images and videos from the text description. This paper extensively reviews the recent state-of-the-art GAN models for text-to-image (T2I) and text-to-video (T2V) synthesis. In this regard, databases like ACM, IEEE Explore, Web of Science, and ScienceDirect were searched to find and analyze the relevant research articles conducted in this area in the last decade, specifically from 2014 to 2024. Secondly, T2I and T2V GAN methods were classified according to structure and functionality. Later, a comprehensive evaluation between T2I and T2V GAN-based methods was conducted, employing various qualitative and quantitative evaluation techniques. Finally, the paper concludes by discussing multiple applications, main challenges, and limitations of T2I and T2V GAN models for future consideration.</div></div>","PeriodicalId":19268,"journal":{"name":"Neurocomputing","volume":"632 ","pages":"Article 129767"},"PeriodicalIF":6.5000,"publicationDate":"2025-02-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Words shaping worlds: A comprehensive exploration of text-driven image and video generation with generative adversarial networks\",\"authors\":\"Mohd Nor Akmal Khalid , Anwar Ullah , Muhammad Numan , Abdul Majid\",\"doi\":\"10.1016/j.neucom.2025.129767\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>A growing interest in education, media, and entertainment has increased Artificial Intelligence-powered content generation, mainly via Generative Adversarial Networks (GANs), which shape images, videos, audio, and text. A generative adversarial network (GAN) is the combination of two deep neural networks: generator (<span><math><mi>G</mi></math></span>) and discriminator (<span><math><mi>D</mi></math></span>). These two components are trained competitively by pitting one against the other such that <span><math><mi>G</mi></math></span> generates new data while <span><math><mi>D</mi></math></span> authenticates the data. By leveraging powerful deep neural networks and competitive training, GANs can synthesize reasonable and realistic images and videos from the text description. This paper extensively reviews the recent state-of-the-art GAN models for text-to-image (T2I) and text-to-video (T2V) synthesis. In this regard, databases like ACM, IEEE Explore, Web of Science, and ScienceDirect were searched to find and analyze the relevant research articles conducted in this area in the last decade, specifically from 2014 to 2024. Secondly, T2I and T2V GAN methods were classified according to structure and functionality. Later, a comprehensive evaluation between T2I and T2V GAN-based methods was conducted, employing various qualitative and quantitative evaluation techniques. Finally, the paper concludes by discussing multiple applications, main challenges, and limitations of T2I and T2V GAN models for future consideration.</div></div>\",\"PeriodicalId\":19268,\"journal\":{\"name\":\"Neurocomputing\",\"volume\":\"632 \",\"pages\":\"Article 129767\"},\"PeriodicalIF\":6.5000,\"publicationDate\":\"2025-02-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Neurocomputing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0925231225004394\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurocomputing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0925231225004394","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
摘要
人们对教育、媒体和娱乐日益增长的兴趣增加了人工智能驱动的内容生成,主要是通过生成对抗网络(GANs)来生成图像、视频、音频和文本。生成对抗网络(GAN)是两个深度神经网络:生成器(G)和鉴别器(D)的组合。这两个组件通过相互竞争来训练,这样G生成新数据,而D验证数据。通过利用强大的深度神经网络和竞争性训练,gan可以从文本描述中合成合理逼真的图像和视频。本文广泛回顾了最新的文本到图像(T2I)和文本到视频(T2V)合成的GAN模型。为此,我们检索了ACM、IEEE Explore、Web of Science、ScienceDirect等数据库,查找并分析了近十年来,特别是2014年至2024年在该领域开展的相关研究文章。其次,根据结构和功能对T2I和T2V GAN方法进行分类。随后,采用各种定性和定量评估技术,对T2I和T2V基于gan的方法进行了综合评估。最后,本文最后讨论了T2I和T2V GAN模型的多种应用、主要挑战和局限性,以供将来考虑。
Words shaping worlds: A comprehensive exploration of text-driven image and video generation with generative adversarial networks
A growing interest in education, media, and entertainment has increased Artificial Intelligence-powered content generation, mainly via Generative Adversarial Networks (GANs), which shape images, videos, audio, and text. A generative adversarial network (GAN) is the combination of two deep neural networks: generator () and discriminator (). These two components are trained competitively by pitting one against the other such that generates new data while authenticates the data. By leveraging powerful deep neural networks and competitive training, GANs can synthesize reasonable and realistic images and videos from the text description. This paper extensively reviews the recent state-of-the-art GAN models for text-to-image (T2I) and text-to-video (T2V) synthesis. In this regard, databases like ACM, IEEE Explore, Web of Science, and ScienceDirect were searched to find and analyze the relevant research articles conducted in this area in the last decade, specifically from 2014 to 2024. Secondly, T2I and T2V GAN methods were classified according to structure and functionality. Later, a comprehensive evaluation between T2I and T2V GAN-based methods was conducted, employing various qualitative and quantitative evaluation techniques. Finally, the paper concludes by discussing multiple applications, main challenges, and limitations of T2I and T2V GAN models for future consideration.
期刊介绍:
Neurocomputing publishes articles describing recent fundamental contributions in the field of neurocomputing. Neurocomputing theory, practice and applications are the essential topics being covered.