{"title":"基于低秩耦合字典学习的多光谱图像超分辨率重建","authors":"Xianlan Lv, Quanhua Zhao, Yu Li","doi":"10.1016/j.infrared.2025.106016","DOIUrl":null,"url":null,"abstract":"<div><div>Spectral super-resolution reconstruction uses auxiliary information and sample learning to mine the spectral mapping relationship from multispectral images to hyperspectral images. Estimating the regression matrix from pairs of multispectral and hyperspectral images is an underdetermined problem, and prior information is often beneficial for the model to seek a more accurate spectral mapping relationship. Therefore, based on the spectral low-rank of hyperspectral images, the spectral super-resolution reconstruction is regarded as the problem of image low-rank reconstruction, and a spectral super-resolution reconstruction method based on low-rank coupled dictionary learning is proposed. Firstly, the method creates a coupling dictionary for multispectral and hyperspectral images with different spectral resolutions in the overlapping region, integrates the minimization of dictionary rank into the sparse representation of dictionary learning, and derives and constructs the optimized learning process of spectral dictionary and sparse coefficient based on ADMM algorithm, thereby reducing sparse error propagation and redundant information in the images. The obtained low-rank coupled dictionary ensures stable reconstruction of the images. Subsequently, the sparse coefficient of the multispectral images of the reconstruction region are utilized, combined with the low-rank dictionary of the hyperspectral images, to achieve spectral super-resolution reconstruction. To investigate the accuracy of the proposed algorithm, experiments were conducted using two sets of real datasets, ZY1-02D and GF5. The experimental results indicate that, compared to the contrast methods, the reconstruction accuracy of the proposed method has improved from the perspectives of element reconstruction quality (RMSE and ERGAS), spatial reconstruction quality (PSNR), spectral reconstruction quality (SAM), and spatial structural reconstruction quality (SSIM). To explore the application value of the proposed method, multispectral images from environments similar to the dataset used in this paper were selected as experimental subjects. Using the optimized dictionary from this paper, high-quality spectral super-resolution products were reconstructed more conveniently through transfer learning. The experimental results confirm the feasibility of the proposed method in practical application environments, effectively reducing the cost of obtaining hyperspectral images.</div></div>","PeriodicalId":13549,"journal":{"name":"Infrared Physics & Technology","volume":"150 ","pages":"Article 106016"},"PeriodicalIF":3.4000,"publicationDate":"2025-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Spectral super-resolution reconstruction of multispectral images based on low-rank coupled dictionary learning\",\"authors\":\"Xianlan Lv, Quanhua Zhao, Yu Li\",\"doi\":\"10.1016/j.infrared.2025.106016\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Spectral super-resolution reconstruction uses auxiliary information and sample learning to mine the spectral mapping relationship from multispectral images to hyperspectral images. Estimating the regression matrix from pairs of multispectral and hyperspectral images is an underdetermined problem, and prior information is often beneficial for the model to seek a more accurate spectral mapping relationship. Therefore, based on the spectral low-rank of hyperspectral images, the spectral super-resolution reconstruction is regarded as the problem of image low-rank reconstruction, and a spectral super-resolution reconstruction method based on low-rank coupled dictionary learning is proposed. Firstly, the method creates a coupling dictionary for multispectral and hyperspectral images with different spectral resolutions in the overlapping region, integrates the minimization of dictionary rank into the sparse representation of dictionary learning, and derives and constructs the optimized learning process of spectral dictionary and sparse coefficient based on ADMM algorithm, thereby reducing sparse error propagation and redundant information in the images. The obtained low-rank coupled dictionary ensures stable reconstruction of the images. Subsequently, the sparse coefficient of the multispectral images of the reconstruction region are utilized, combined with the low-rank dictionary of the hyperspectral images, to achieve spectral super-resolution reconstruction. To investigate the accuracy of the proposed algorithm, experiments were conducted using two sets of real datasets, ZY1-02D and GF5. The experimental results indicate that, compared to the contrast methods, the reconstruction accuracy of the proposed method has improved from the perspectives of element reconstruction quality (RMSE and ERGAS), spatial reconstruction quality (PSNR), spectral reconstruction quality (SAM), and spatial structural reconstruction quality (SSIM). To explore the application value of the proposed method, multispectral images from environments similar to the dataset used in this paper were selected as experimental subjects. Using the optimized dictionary from this paper, high-quality spectral super-resolution products were reconstructed more conveniently through transfer learning. The experimental results confirm the feasibility of the proposed method in practical application environments, effectively reducing the cost of obtaining hyperspectral images.</div></div>\",\"PeriodicalId\":13549,\"journal\":{\"name\":\"Infrared Physics & Technology\",\"volume\":\"150 \",\"pages\":\"Article 106016\"},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2025-07-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Infrared Physics & Technology\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1350449525003093\",\"RegionNum\":3,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"INSTRUMENTS & INSTRUMENTATION\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Infrared Physics & Technology","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1350449525003093","RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"INSTRUMENTS & INSTRUMENTATION","Score":null,"Total":0}
Spectral super-resolution reconstruction of multispectral images based on low-rank coupled dictionary learning
Spectral super-resolution reconstruction uses auxiliary information and sample learning to mine the spectral mapping relationship from multispectral images to hyperspectral images. Estimating the regression matrix from pairs of multispectral and hyperspectral images is an underdetermined problem, and prior information is often beneficial for the model to seek a more accurate spectral mapping relationship. Therefore, based on the spectral low-rank of hyperspectral images, the spectral super-resolution reconstruction is regarded as the problem of image low-rank reconstruction, and a spectral super-resolution reconstruction method based on low-rank coupled dictionary learning is proposed. Firstly, the method creates a coupling dictionary for multispectral and hyperspectral images with different spectral resolutions in the overlapping region, integrates the minimization of dictionary rank into the sparse representation of dictionary learning, and derives and constructs the optimized learning process of spectral dictionary and sparse coefficient based on ADMM algorithm, thereby reducing sparse error propagation and redundant information in the images. The obtained low-rank coupled dictionary ensures stable reconstruction of the images. Subsequently, the sparse coefficient of the multispectral images of the reconstruction region are utilized, combined with the low-rank dictionary of the hyperspectral images, to achieve spectral super-resolution reconstruction. To investigate the accuracy of the proposed algorithm, experiments were conducted using two sets of real datasets, ZY1-02D and GF5. The experimental results indicate that, compared to the contrast methods, the reconstruction accuracy of the proposed method has improved from the perspectives of element reconstruction quality (RMSE and ERGAS), spatial reconstruction quality (PSNR), spectral reconstruction quality (SAM), and spatial structural reconstruction quality (SSIM). To explore the application value of the proposed method, multispectral images from environments similar to the dataset used in this paper were selected as experimental subjects. Using the optimized dictionary from this paper, high-quality spectral super-resolution products were reconstructed more conveniently through transfer learning. The experimental results confirm the feasibility of the proposed method in practical application environments, effectively reducing the cost of obtaining hyperspectral images.
期刊介绍:
The Journal covers the entire field of infrared physics and technology: theory, experiment, application, devices and instrumentation. Infrared'' is defined as covering the near, mid and far infrared (terahertz) regions from 0.75um (750nm) to 1mm (300GHz.) Submissions in the 300GHz to 100GHz region may be accepted at the editors discretion if their content is relevant to shorter wavelengths. Submissions must be primarily concerned with and directly relevant to this spectral region.
Its core topics can be summarized as the generation, propagation and detection, of infrared radiation; the associated optics, materials and devices; and its use in all fields of science, industry, engineering and medicine.
Infrared techniques occur in many different fields, notably spectroscopy and interferometry; material characterization and processing; atmospheric physics, astronomy and space research. Scientific aspects include lasers, quantum optics, quantum electronics, image processing and semiconductor physics. Some important applications are medical diagnostics and treatment, industrial inspection and environmental monitoring.