Lianglin Zou;Ping Tang;Yisen Niu;Zixuan Yan;Xilong Lin;Jifeng Song;Qian Wang
{"title":"基于云图像深度特征匹配的云运动估计方法","authors":"Lianglin Zou;Ping Tang;Yisen Niu;Zixuan Yan;Xilong Lin;Jifeng Song;Qian Wang","doi":"10.1109/LGRS.2024.3491094","DOIUrl":null,"url":null,"abstract":"The movement of clouds directly influences fluctuations in solar radiation. Therefore, cloud motion vector (CMV) estimation techniques are widely applied in sequential cloud images to predict solar radiation and study other meteorologically related fields. However, traditional block matching, optical flow, and feature point methods struggle to accurately capture the deformation, multilayered, and mixed cloud types’ motion due to the lack of deep semantic understanding of cloud images. Additionally, without cloud-motion-labeled, deep learning tools such as CNNs are limited in their utility for motion assessment. Therefore, this letter proposes a method of cloud image depth feature matching to assess the CMV in time series, including image enhancement, self-supervised feature extraction, feature matching, feature fusion, and spatiotemporal filtering. Experimental results demonstrate a significant improvement in accuracy compared to traditional CMV estimation techniques, with higher robustness observed across various complex cloud scenarios.","PeriodicalId":91017,"journal":{"name":"IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society","volume":"22 ","pages":"1-5"},"PeriodicalIF":0.0000,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Cloud Motion Estimation Method Based on Cloud Image Depth Feature Matching\",\"authors\":\"Lianglin Zou;Ping Tang;Yisen Niu;Zixuan Yan;Xilong Lin;Jifeng Song;Qian Wang\",\"doi\":\"10.1109/LGRS.2024.3491094\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The movement of clouds directly influences fluctuations in solar radiation. Therefore, cloud motion vector (CMV) estimation techniques are widely applied in sequential cloud images to predict solar radiation and study other meteorologically related fields. However, traditional block matching, optical flow, and feature point methods struggle to accurately capture the deformation, multilayered, and mixed cloud types’ motion due to the lack of deep semantic understanding of cloud images. Additionally, without cloud-motion-labeled, deep learning tools such as CNNs are limited in their utility for motion assessment. Therefore, this letter proposes a method of cloud image depth feature matching to assess the CMV in time series, including image enhancement, self-supervised feature extraction, feature matching, feature fusion, and spatiotemporal filtering. Experimental results demonstrate a significant improvement in accuracy compared to traditional CMV estimation techniques, with higher robustness observed across various complex cloud scenarios.\",\"PeriodicalId\":91017,\"journal\":{\"name\":\"IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society\",\"volume\":\"22 \",\"pages\":\"1-5\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-11-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10742388/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10742388/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A Cloud Motion Estimation Method Based on Cloud Image Depth Feature Matching
The movement of clouds directly influences fluctuations in solar radiation. Therefore, cloud motion vector (CMV) estimation techniques are widely applied in sequential cloud images to predict solar radiation and study other meteorologically related fields. However, traditional block matching, optical flow, and feature point methods struggle to accurately capture the deformation, multilayered, and mixed cloud types’ motion due to the lack of deep semantic understanding of cloud images. Additionally, without cloud-motion-labeled, deep learning tools such as CNNs are limited in their utility for motion assessment. Therefore, this letter proposes a method of cloud image depth feature matching to assess the CMV in time series, including image enhancement, self-supervised feature extraction, feature matching, feature fusion, and spatiotemporal filtering. Experimental results demonstrate a significant improvement in accuracy compared to traditional CMV estimation techniques, with higher robustness observed across various complex cloud scenarios.