Shruti Chaudhari , Anuradha Thakare , Ahmed M. Anter
{"title":"PSOGSA: A parallel implementation model for data clustering using new hybrid swarm intelligence and improved machine learning technique","authors":"Shruti Chaudhari , Anuradha Thakare , Ahmed M. Anter","doi":"10.1016/j.suscom.2023.100953","DOIUrl":null,"url":null,"abstract":"<div><p><span><span><span>With the digitization of the entire world and huge requirements of understanding unknown patterns from the data, clustering becomes an important research area. The quick and accurate division of large datasets with a range of properties or features becomes challenging. The parallel implementation of clustering algorithms<span> must satisfy stringent computational requirements to handle large amounts of data. This can be achieved by designing a GPU based optimal </span></span>computational model<span><span> with a heuristic approach. Swarm Intelligence (SI), a family of bio-inspired algorithms, that has been effectively applied to a number of real-world </span>clustering problems<span>. The Gravitational Search Algorithm (GSA) is a </span></span></span>heuristic search<span><span> optimization approach based on Newton's Law of Gravitation and mass interactions. Although it has a slow searching rate in the last iterations, this strategy has been proved to be capable of discovering the global optimum. This paper presents GPU based hybrid </span>parallel algorithms<span> for data clustering. A newly developed, hybrid </span></span></span>Particle Swarm Optimization<span> (PSO) and Gravitational Search Algorithm (GSA) i.e., PSOGSA achieves the global optima. PSOGSA utilizes novel training methods for enhanced Neural Networks<span> (NN) in order to examine the efficiency of algorithms and resolves the challenges of trapping in local minima. This also shows the sluggish convergence rate of standard evolutionary learning algorithms. The Nearest Neighbour Partition (Partitioning of the Neighbourhood) algorithm can be used to improve the performance of NN. A parallel version of Hybrid PSOGSA with NN is implemented to achieve optimal results with better computational time. Compared to the CPU-based regular PSO, the suggested Hybrid PSOGSA with NN achieved optimal clustering with 71% improved computational time.</span></span></p></div>","PeriodicalId":48686,"journal":{"name":"Sustainable Computing-Informatics & Systems","volume":"41 ","pages":"Article 100953"},"PeriodicalIF":3.8000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Sustainable Computing-Informatics & Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2210537923001087","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
引用次数: 0
Abstract
With the digitization of the entire world and huge requirements of understanding unknown patterns from the data, clustering becomes an important research area. The quick and accurate division of large datasets with a range of properties or features becomes challenging. The parallel implementation of clustering algorithms must satisfy stringent computational requirements to handle large amounts of data. This can be achieved by designing a GPU based optimal computational model with a heuristic approach. Swarm Intelligence (SI), a family of bio-inspired algorithms, that has been effectively applied to a number of real-world clustering problems. The Gravitational Search Algorithm (GSA) is a heuristic search optimization approach based on Newton's Law of Gravitation and mass interactions. Although it has a slow searching rate in the last iterations, this strategy has been proved to be capable of discovering the global optimum. This paper presents GPU based hybrid parallel algorithms for data clustering. A newly developed, hybrid Particle Swarm Optimization (PSO) and Gravitational Search Algorithm (GSA) i.e., PSOGSA achieves the global optima. PSOGSA utilizes novel training methods for enhanced Neural Networks (NN) in order to examine the efficiency of algorithms and resolves the challenges of trapping in local minima. This also shows the sluggish convergence rate of standard evolutionary learning algorithms. The Nearest Neighbour Partition (Partitioning of the Neighbourhood) algorithm can be used to improve the performance of NN. A parallel version of Hybrid PSOGSA with NN is implemented to achieve optimal results with better computational time. Compared to the CPU-based regular PSO, the suggested Hybrid PSOGSA with NN achieved optimal clustering with 71% improved computational time.
随着整个世界的数字化和从数据中理解未知模式的巨大需求,聚类成为一个重要的研究领域。如何快速、准确地划分具有各种属性或特征的大型数据集成为一项挑战。聚类算法的并行执行必须满足处理大量数据的严格计算要求。这可以通过采用启发式方法设计基于 GPU 的最优计算模型来实现。蜂群智能(SI)是一系列生物启发算法,已被有效地应用于现实世界中的许多聚类问题。重力搜索算法(GSA)是一种基于牛顿万有引力定律和质量相互作用的启发式搜索优化方法。虽然在最后一次迭代中搜索速度较慢,但这一策略已被证明能够发现全局最优。本文介绍了基于 GPU 的数据聚类混合并行算法。一种新开发的混合粒子群优化算法(PSO)和重力搜索算法(GSA),即 PSOGSA,可实现全局最优。PSOGSA 利用增强型神经网络 (NN) 的新型训练方法来检验算法的效率,并解决陷入局部最小值的难题。这也显示了标准进化学习算法收敛速度缓慢的问题。近邻分割(Partitioning of the Neighbourhood)算法可用于提高 NN 的性能。为了在更短的计算时间内获得最佳结果,实现了带有 NN 的混合 PSOGSA 并行版本。与基于 CPU 的普通 PSO 相比,建议的混合 NN PSOGSA 实现了最佳聚类,计算时间缩短了 71%。
期刊介绍:
Sustainable computing is a rapidly expanding research area spanning the fields of computer science and engineering, electrical engineering as well as other engineering disciplines. The aim of Sustainable Computing: Informatics and Systems (SUSCOM) is to publish the myriad research findings related to energy-aware and thermal-aware management of computing resource. Equally important is a spectrum of related research issues such as applications of computing that can have ecological and societal impacts. SUSCOM publishes original and timely research papers and survey articles in current areas of power, energy, temperature, and environment related research areas of current importance to readers. SUSCOM has an editorial board comprising prominent researchers from around the world and selects competitively evaluated peer-reviewed papers.