{"title":"图像超分辨率的扩散模型:现状和未来方向","authors":"Garas Gendy , Guanghui He , Nabil Sabor","doi":"10.1016/j.neucom.2024.128911","DOIUrl":null,"url":null,"abstract":"<div><div>The single image super-resolution (SISR) task has received much attention due to the wide range of applications in many tasks. The progress in this SISR is mainly based on deep learning methods. In recent years, many methods have been developed based on using diffusion models to solve the SISR task. The performance of the diffusion-based model depends on many factors, such as the type of diffusion, noise schedule, and loss function. Based on this limitation, we developed a review paper about the state-of-the-art diffusion models, especially ones that were developed for SR. In this survey, the SR-based diffusion models are classified based on four metrics, namely the diffusion model type, the noise schedule, the loss function, and the used datasets. Then, we discuss the main categories in each metric and the developed diffusion models related to each category. Three main diffusion model types are considered, including denoising diffusion probabilistic models (DDPM), noise-conditioned score networks (NCSN), and stochastic differential equations models (SDEM), in addition to other diffusion models. In the end, we discuss the limitations of these diffusion models and show our expectations for future research in this domain.</div></div>","PeriodicalId":19268,"journal":{"name":"Neurocomputing","volume":"617 ","pages":"Article 128911"},"PeriodicalIF":6.5000,"publicationDate":"2025-02-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Diffusion models for image super-resolution: State-of-the-art and future directions\",\"authors\":\"Garas Gendy , Guanghui He , Nabil Sabor\",\"doi\":\"10.1016/j.neucom.2024.128911\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The single image super-resolution (SISR) task has received much attention due to the wide range of applications in many tasks. The progress in this SISR is mainly based on deep learning methods. In recent years, many methods have been developed based on using diffusion models to solve the SISR task. The performance of the diffusion-based model depends on many factors, such as the type of diffusion, noise schedule, and loss function. Based on this limitation, we developed a review paper about the state-of-the-art diffusion models, especially ones that were developed for SR. In this survey, the SR-based diffusion models are classified based on four metrics, namely the diffusion model type, the noise schedule, the loss function, and the used datasets. Then, we discuss the main categories in each metric and the developed diffusion models related to each category. Three main diffusion model types are considered, including denoising diffusion probabilistic models (DDPM), noise-conditioned score networks (NCSN), and stochastic differential equations models (SDEM), in addition to other diffusion models. In the end, we discuss the limitations of these diffusion models and show our expectations for future research in this domain.</div></div>\",\"PeriodicalId\":19268,\"journal\":{\"name\":\"Neurocomputing\",\"volume\":\"617 \",\"pages\":\"Article 128911\"},\"PeriodicalIF\":6.5000,\"publicationDate\":\"2025-02-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Neurocomputing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0925231224016825\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurocomputing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0925231224016825","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Diffusion models for image super-resolution: State-of-the-art and future directions
The single image super-resolution (SISR) task has received much attention due to the wide range of applications in many tasks. The progress in this SISR is mainly based on deep learning methods. In recent years, many methods have been developed based on using diffusion models to solve the SISR task. The performance of the diffusion-based model depends on many factors, such as the type of diffusion, noise schedule, and loss function. Based on this limitation, we developed a review paper about the state-of-the-art diffusion models, especially ones that were developed for SR. In this survey, the SR-based diffusion models are classified based on four metrics, namely the diffusion model type, the noise schedule, the loss function, and the used datasets. Then, we discuss the main categories in each metric and the developed diffusion models related to each category. Three main diffusion model types are considered, including denoising diffusion probabilistic models (DDPM), noise-conditioned score networks (NCSN), and stochastic differential equations models (SDEM), in addition to other diffusion models. In the end, we discuss the limitations of these diffusion models and show our expectations for future research in this domain.
期刊介绍:
Neurocomputing publishes articles describing recent fundamental contributions in the field of neurocomputing. Neurocomputing theory, practice and applications are the essential topics being covered.