Optimal Gossip Algorithms for Exact and Approximate Quantile Computations

Bernhard Haeupler, Jeet Mohapatra, Hsin-Hao Su
{"title":"Optimal Gossip Algorithms for Exact and Approximate Quantile Computations","authors":"Bernhard Haeupler, Jeet Mohapatra, Hsin-Hao Su","doi":"10.1145/3212734.3212770","DOIUrl":null,"url":null,"abstract":"This paper gives drastically faster gossip algorithms to compute exact and approximate quantiles. Gossip algorithms, which allow each node to contact a uniformly random other node in each round, have been intensely studied and been adopted in many applications due to their fast convergence and their robustness to failures. Kempe et al. [24] gave gossip algorithms to compute important aggregate statistics if every node is given a value. In particular, they gave a beautiful O(logn + log 1 ε ) round algorithm to ε-approximate the sum of all values and an O(log2 n) round algorithm to compute the exact Φ-quantile, i.e., the ?Φn? smallest value. We give an quadratically faster and in fact optimal gossip algorithm for the exact Φ-quantile problem which runs in O(logn) rounds. We furthermore show that one can achieve an exponential speedup if one allows for an ε-approximation. In particular, we give an O(log logn + log 1 ε ) round gossip algorithm which computes a value of rank between Φn and (Φ + ε)n at every node. Our algorithms are extremely simple and very robust - they can be operated with the same running times even if every transmission fails with a, potentially different, constant probability. We also give a matching Ω(log logn + log 1 ε ) lower bound which shows that our algorithm is optimal for all values of ε.","PeriodicalId":198284,"journal":{"name":"Proceedings of the 2018 ACM Symposium on Principles of Distributed Computing","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2017-11-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"9","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 2018 ACM Symposium on Principles of Distributed Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3212734.3212770","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 9

Abstract

This paper gives drastically faster gossip algorithms to compute exact and approximate quantiles. Gossip algorithms, which allow each node to contact a uniformly random other node in each round, have been intensely studied and been adopted in many applications due to their fast convergence and their robustness to failures. Kempe et al. [24] gave gossip algorithms to compute important aggregate statistics if every node is given a value. In particular, they gave a beautiful O(logn + log 1 ε ) round algorithm to ε-approximate the sum of all values and an O(log2 n) round algorithm to compute the exact Φ-quantile, i.e., the ?Φn? smallest value. We give an quadratically faster and in fact optimal gossip algorithm for the exact Φ-quantile problem which runs in O(logn) rounds. We furthermore show that one can achieve an exponential speedup if one allows for an ε-approximation. In particular, we give an O(log logn + log 1 ε ) round gossip algorithm which computes a value of rank between Φn and (Φ + ε)n at every node. Our algorithms are extremely simple and very robust - they can be operated with the same running times even if every transmission fails with a, potentially different, constant probability. We also give a matching Ω(log logn + log 1 ε ) lower bound which shows that our algorithm is optimal for all values of ε.
精确和近似分位数计算的最佳八卦算法
本文给出了更快的八卦算法来计算精确和近似分位数。流言算法允许每个节点在每轮中与一个均匀随机的其他节点接触,由于其快速收敛和对故障的鲁棒性,已经被广泛研究并应用于许多应用中。Kempe等人[24]给出了在每个节点都给定一个值的情况下计算重要聚合统计信息的八卦算法。特别地,他们给出了一个漂亮的O(logn + log 1 ε)轮算法来ε-近似所有值的和和一个O(log2 n)轮算法来计算精确的Φ-quantile,即?Φn?最小值。对于0 (logn)轮运行的Φ-quantile问题,我们给出了一个二次更快且实际上最优的八卦算法。我们进一步证明,如果允许ε-近似,可以实现指数加速。特别地,我们给出了一个O(log logn + log 1 ε)轮八卦算法,该算法在每个节点上计算Φn和(Φ + ε)n之间的秩值。我们的算法非常简单且非常健壮——即使每次传输失败的概率可能不同,它们也可以在相同的运行时间内运行。我们还给出了一个匹配的Ω(log logn + log 1 ε)下界,这表明我们的算法对所有ε值都是最优的。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信