Vincent Cohen-Addad, Frederik Mallmann-Trenn, David Saulpic
{"title":"具有可证明保证的大规模并行模块化最大化算法","authors":"Vincent Cohen-Addad, Frederik Mallmann-Trenn, David Saulpic","doi":"10.1145/3519270.3538449","DOIUrl":null,"url":null,"abstract":"Graph clustering is one of the most basic and popular unsupervised learning problems. Among the different formulations of the problem, the modularity objective has been particularly successful in helping design impactful algorithms; Most notably, the Louvain algorithm has become one of the most used algorithm for clustering graphs. However, one major limitation of the Louvain algorithm is its sequential nature which makes it impractical in distributed environments and on massive datasets. In this paper, we provide a parallel version of Louvain which works in the massively parallel computation model (MPC). We show that it recovers the ground-truth clusters in the classic stochastic block model in only a constant number of parallel rounds, and so for a wider regime of parameters than the standard Louvain algorithm as shown recently in [Cohen-Addad et al. 2020].","PeriodicalId":182444,"journal":{"name":"Proceedings of the 2022 ACM Symposium on Principles of Distributed Computing","volume":"86 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"A Massively Parallel Modularity-Maximizing Algorithm with Provable Guarantees\",\"authors\":\"Vincent Cohen-Addad, Frederik Mallmann-Trenn, David Saulpic\",\"doi\":\"10.1145/3519270.3538449\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Graph clustering is one of the most basic and popular unsupervised learning problems. Among the different formulations of the problem, the modularity objective has been particularly successful in helping design impactful algorithms; Most notably, the Louvain algorithm has become one of the most used algorithm for clustering graphs. However, one major limitation of the Louvain algorithm is its sequential nature which makes it impractical in distributed environments and on massive datasets. In this paper, we provide a parallel version of Louvain which works in the massively parallel computation model (MPC). We show that it recovers the ground-truth clusters in the classic stochastic block model in only a constant number of parallel rounds, and so for a wider regime of parameters than the standard Louvain algorithm as shown recently in [Cohen-Addad et al. 2020].\",\"PeriodicalId\":182444,\"journal\":{\"name\":\"Proceedings of the 2022 ACM Symposium on Principles of Distributed Computing\",\"volume\":\"86 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-07-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 2022 ACM Symposium on Principles of Distributed Computing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3519270.3538449\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2022 ACM Symposium on Principles of Distributed Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3519270.3538449","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2
摘要
图聚类是最基本和最流行的无监督学习问题之一。在问题的不同表述中,模块化目标在帮助设计有影响力的算法方面特别成功;最值得注意的是,Louvain算法已经成为聚类图最常用的算法之一。然而,Louvain算法的一个主要限制是它的顺序性,这使得它在分布式环境和大量数据集上不切实际。在本文中,我们提供了一个在大规模并行计算模型(MPC)下工作的Louvain的并行版本。我们表明,它在经典随机块模型中仅在恒定数量的平行轮中恢复基本真聚类,因此比标准Louvain算法的参数范围更广,如最近在[Cohen-Addad et al. 2020]中所示。
A Massively Parallel Modularity-Maximizing Algorithm with Provable Guarantees
Graph clustering is one of the most basic and popular unsupervised learning problems. Among the different formulations of the problem, the modularity objective has been particularly successful in helping design impactful algorithms; Most notably, the Louvain algorithm has become one of the most used algorithm for clustering graphs. However, one major limitation of the Louvain algorithm is its sequential nature which makes it impractical in distributed environments and on massive datasets. In this paper, we provide a parallel version of Louvain which works in the massively parallel computation model (MPC). We show that it recovers the ground-truth clusters in the classic stochastic block model in only a constant number of parallel rounds, and so for a wider regime of parameters than the standard Louvain algorithm as shown recently in [Cohen-Addad et al. 2020].