Michal Kawulok;Pawel Kowaleczko;Maciej Ziaja;Jakub Nalepa;Daniel Kostrzewa;Daniele Latini;Davide De Santis;Giorgia Salvucci;Ilaria Petracca;Valeria La Pegna;Zoltan Bartalis;Fabio Del Frate
{"title":"Hyperspectral Image Super-Resolution: Task-Based Evaluation","authors":"Michal Kawulok;Pawel Kowaleczko;Maciej Ziaja;Jakub Nalepa;Daniel Kostrzewa;Daniele Latini;Davide De Santis;Giorgia Salvucci;Ilaria Petracca;Valeria La Pegna;Zoltan Bartalis;Fabio Del Frate","doi":"10.1109/JSTARS.2024.3475644","DOIUrl":null,"url":null,"abstract":"The need for enhancing image spatial resolution has motivated the researchers to propose numerous super-resolution (SR) techniques, including those developed specifically for hyperspectral data. Despite significant advancements in this field attributed to deep learning, little attention has been given to evaluating the practical value of super-resolved images in specific applications. Most methods are validated in application-independent scenarios, often using simulated low-resolution images, resulting in overly optimistic conclusions. In this article, we propose task-based evaluation strategies for hyperspectral image SR and we present results obtained with various approaches that include pansharpening, multispectral–hyperspectral data fusion, and single-image SR. We demonstrate that the proposed framework allows us to highlight both benefits and limitations of each method and can, therefore, guide the development of SR techniques suitable for real-world applications.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":"17 ","pages":"18949-18966"},"PeriodicalIF":4.7000,"publicationDate":"2024-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10706841","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10706841/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
The need for enhancing image spatial resolution has motivated the researchers to propose numerous super-resolution (SR) techniques, including those developed specifically for hyperspectral data. Despite significant advancements in this field attributed to deep learning, little attention has been given to evaluating the practical value of super-resolved images in specific applications. Most methods are validated in application-independent scenarios, often using simulated low-resolution images, resulting in overly optimistic conclusions. In this article, we propose task-based evaluation strategies for hyperspectral image SR and we present results obtained with various approaches that include pansharpening, multispectral–hyperspectral data fusion, and single-image SR. We demonstrate that the proposed framework allows us to highlight both benefits and limitations of each method and can, therefore, guide the development of SR techniques suitable for real-world applications.
对提高图像空间分辨率的需求促使研究人员提出了许多超分辨率(SR)技术,包括专门为高光谱数据开发的技术。尽管深度学习在这一领域取得了重大进展,但人们很少关注评估超分辨率图像在具体应用中的实际价值。大多数方法都是在与应用无关的情况下进行验证的,通常使用模拟的低分辨率图像,结果得出的结论过于乐观。在本文中,我们提出了基于任务的超光谱图像 SR 评估策略,并介绍了使用各种方法(包括平锐化、多光谱-高光谱数据融合和单图像 SR)获得的结果。我们证明,所提出的框架使我们能够突出每种方法的优点和局限性,因此可以指导适合实际应用的 SR 技术的开发。
期刊介绍:
The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.