Parallel ISODATA Clustering of Remote Sensing Images Based on MapReduce

Bo Li, Hui Zhao, Zhenhua Lv
{"title":"Parallel ISODATA Clustering of Remote Sensing Images Based on MapReduce","authors":"Bo Li, Hui Zhao, Zhenhua Lv","doi":"10.1109/CYBERC.2010.75","DOIUrl":null,"url":null,"abstract":"The ISODATA clustering algorithm is regarded as a common method in the field of analyzing remote sensing images. It is very effective to generate a preliminary overview of images. These kinds of clustering methods are currently done in personal computers. However, with the development of remote sensing technology, the spatial resolutions are increasing rapidly and the sizes of the data are becoming larger. Clustering large amounts of images is considerably time-consuming in personal computers because of the limitation of both hardware and software resources. Researchers have developed many kinds of variants of the ISODATA algorithm executing in parallel, and most of them are implemented by using MPI. Generally, writing programs in MPI requires sophisticated skills of the user. Different with the former studies, we propose in this paper to parallel ISODATA clustering algorithm on Map Reduce, another parallel programming model that is very easy to use. The algorithm is mainly divided into two steps defined by the framework of Map Reduce, and they are detailed by pseudo-codes. To improve the accuracies of the color values, the color space CIELAB is used instead of RGB. The experiment results demonstrates that our proposed algorithm possess a robust scalability and the computational time substantially reduced through increasing the number of nodes and it may inspire new solutions of other similar problems.","PeriodicalId":315132,"journal":{"name":"2010 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery","volume":"2 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2010-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"53","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2010 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CYBERC.2010.75","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 53

Abstract

The ISODATA clustering algorithm is regarded as a common method in the field of analyzing remote sensing images. It is very effective to generate a preliminary overview of images. These kinds of clustering methods are currently done in personal computers. However, with the development of remote sensing technology, the spatial resolutions are increasing rapidly and the sizes of the data are becoming larger. Clustering large amounts of images is considerably time-consuming in personal computers because of the limitation of both hardware and software resources. Researchers have developed many kinds of variants of the ISODATA algorithm executing in parallel, and most of them are implemented by using MPI. Generally, writing programs in MPI requires sophisticated skills of the user. Different with the former studies, we propose in this paper to parallel ISODATA clustering algorithm on Map Reduce, another parallel programming model that is very easy to use. The algorithm is mainly divided into two steps defined by the framework of Map Reduce, and they are detailed by pseudo-codes. To improve the accuracies of the color values, the color space CIELAB is used instead of RGB. The experiment results demonstrates that our proposed algorithm possess a robust scalability and the computational time substantially reduced through increasing the number of nodes and it may inspire new solutions of other similar problems.
基于MapReduce的遥感图像并行ISODATA聚类
ISODATA聚类算法被认为是遥感图像分析领域的常用方法。生成图像的初步概览是非常有效的。这些类型的聚类方法目前是在个人计算机中完成的。然而,随着遥感技术的发展,空间分辨率迅速提高,数据量也越来越大。由于硬件和软件资源的限制,在个人计算机中对大量图像进行聚类是相当耗时的。研究人员已经开发了多种并行执行的ISODATA算法变体,其中大多数都是通过MPI实现的。一般来说,用MPI编写程序需要用户的复杂技能。与以往的研究不同的是,本文提出了另一种易于使用的并行编程模型Map Reduce上的并行ISODATA聚类算法。该算法主要分为两个步骤,由Map Reduce框架定义,并通过伪代码对其进行详细描述。为了提高颜色值的准确性,使用CIELAB颜色空间代替RGB。实验结果表明,本文提出的算法具有较强的可扩展性,通过增加节点数量大大减少了计算时间,可以启发其他类似问题的新解决方案。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信