An accelerated distributed method with inexact model of relative smoothness and strong convexity

IF 1.1 4区 工程技术 Q4 ENGINEERING, ELECTRICAL & ELECTRONIC
Xuexue Zhang, Sanyang Liu, Nannan Zhao
{"title":"An accelerated distributed method with inexact model of relative smoothness and strong convexity","authors":"Xuexue Zhang,&nbsp;Sanyang Liu,&nbsp;Nannan Zhao","doi":"10.1049/sil2.12199","DOIUrl":null,"url":null,"abstract":"<p>Distributed optimisation methods are widely applied in many systems where agents cooperate with each other to minimise a sum-type problem over a connected network. An accelerated distributed method based on the inexact model of relative smoothness and strong convexity is introduced by the authors. The authors demonstrate that the proposed method can converge to the optimal solution at the linear rate <math>\n <semantics>\n <mrow>\n <mfrac>\n <mn>1</mn>\n <msup>\n <mrow>\n <mo>(</mo>\n <mrow>\n <mn>1</mn>\n <mo>+</mo>\n <mn>1</mn>\n <mo>/</mo>\n <mrow>\n <mo>(</mo>\n <mrow>\n <mn>4</mn>\n <msqrt>\n <msub>\n <mi>κ</mi>\n <mi>g</mi>\n </msub>\n </msqrt>\n </mrow>\n <mo>)</mo>\n </mrow>\n </mrow>\n <mo>)</mo>\n </mrow>\n <mn>2</mn>\n </msup>\n </mfrac>\n </mrow>\n <annotation> $\\frac{1}{{(1+1/(4\\sqrt{{\\kappa }_{g}}))}^{2}}$</annotation>\n </semantics></math> and achieve the optimal gradient computation complexity and the near optimal communication complexity, where <i>κ</i><sub><i>g</i></sub> denotes the global condition number. Finally, the numerical experiments are provided to validate the theoretical results and further show the efficacy of the proposed method.</p>","PeriodicalId":56301,"journal":{"name":"IET Signal Processing","volume":null,"pages":null},"PeriodicalIF":1.1000,"publicationDate":"2023-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/sil2.12199","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/sil2.12199","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Distributed optimisation methods are widely applied in many systems where agents cooperate with each other to minimise a sum-type problem over a connected network. An accelerated distributed method based on the inexact model of relative smoothness and strong convexity is introduced by the authors. The authors demonstrate that the proposed method can converge to the optimal solution at the linear rate 1 ( 1 + 1 / ( 4 κ g ) ) 2 $\frac{1}{{(1+1/(4\sqrt{{\kappa }_{g}}))}^{2}}$ and achieve the optimal gradient computation complexity and the near optimal communication complexity, where κg denotes the global condition number. Finally, the numerical experiments are provided to validate the theoretical results and further show the efficacy of the proposed method.

Abstract Image

一种具有相对光滑和强凸性的不精确模型的加速分布方法
分布式优化方法广泛应用于许多系统中,其中代理相互协作以最小化连接网络上的和型问题。介绍了一种基于相对光滑和强凸性的不精确模型的加速分布方法。作者证明了所提出的方法可以在线性速率为1时收敛到最优解(1+1/(4κg)2$\frac{1}{(1+1/(4\sqrt{\kappa}_{g}))}^{2}}$,并实现最优梯度计算复杂性和接近最优的通信复杂性,其中κg表示全局条件数。最后,通过数值实验验证了理论结果,进一步验证了该方法的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IET Signal Processing
IET Signal Processing 工程技术-工程:电子与电气
CiteScore
3.80
自引率
5.90%
发文量
83
审稿时长
9.5 months
期刊介绍: IET Signal Processing publishes research on a diverse range of signal processing and machine learning topics, covering a variety of applications, disciplines, modalities, and techniques in detection, estimation, inference, and classification problems. The research published includes advances in algorithm design for the analysis of single and high-multi-dimensional data, sparsity, linear and non-linear systems, recursive and non-recursive digital filters and multi-rate filter banks, as well a range of topics that span from sensor array processing, deep convolutional neural network based approaches to the application of chaos theory, and far more. Topics covered by scope include, but are not limited to: advances in single and multi-dimensional filter design and implementation linear and nonlinear, fixed and adaptive digital filters and multirate filter banks statistical signal processing techniques and analysis classical, parametric and higher order spectral analysis signal transformation and compression techniques, including time-frequency analysis system modelling and adaptive identification techniques machine learning based approaches to signal processing Bayesian methods for signal processing, including Monte-Carlo Markov-chain and particle filtering techniques theory and application of blind and semi-blind signal separation techniques signal processing techniques for analysis, enhancement, coding, synthesis and recognition of speech signals direction-finding and beamforming techniques for audio and electromagnetic signals analysis techniques for biomedical signals baseband signal processing techniques for transmission and reception of communication signals signal processing techniques for data hiding and audio watermarking sparse signal processing and compressive sensing Special Issue Call for Papers: Intelligent Deep Fuzzy Model for Signal Processing - https://digital-library.theiet.org/files/IET_SPR_CFP_IDFMSP.pdf
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信