{"title":"An accelerated distributed method with inexact model of relative smoothness and strong convexity","authors":"Xuexue Zhang, Sanyang Liu, Nannan Zhao","doi":"10.1049/sil2.12199","DOIUrl":null,"url":null,"abstract":"<p>Distributed optimisation methods are widely applied in many systems where agents cooperate with each other to minimise a sum-type problem over a connected network. An accelerated distributed method based on the inexact model of relative smoothness and strong convexity is introduced by the authors. The authors demonstrate that the proposed method can converge to the optimal solution at the linear rate <math>\n <semantics>\n <mrow>\n <mfrac>\n <mn>1</mn>\n <msup>\n <mrow>\n <mo>(</mo>\n <mrow>\n <mn>1</mn>\n <mo>+</mo>\n <mn>1</mn>\n <mo>/</mo>\n <mrow>\n <mo>(</mo>\n <mrow>\n <mn>4</mn>\n <msqrt>\n <msub>\n <mi>κ</mi>\n <mi>g</mi>\n </msub>\n </msqrt>\n </mrow>\n <mo>)</mo>\n </mrow>\n </mrow>\n <mo>)</mo>\n </mrow>\n <mn>2</mn>\n </msup>\n </mfrac>\n </mrow>\n <annotation> $\\frac{1}{{(1+1/(4\\sqrt{{\\kappa }_{g}}))}^{2}}$</annotation>\n </semantics></math> and achieve the optimal gradient computation complexity and the near optimal communication complexity, where <i>κ</i><sub><i>g</i></sub> denotes the global condition number. Finally, the numerical experiments are provided to validate the theoretical results and further show the efficacy of the proposed method.</p>","PeriodicalId":56301,"journal":{"name":"IET Signal Processing","volume":"17 4","pages":""},"PeriodicalIF":1.1000,"publicationDate":"2023-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/sil2.12199","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/sil2.12199","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Distributed optimisation methods are widely applied in many systems where agents cooperate with each other to minimise a sum-type problem over a connected network. An accelerated distributed method based on the inexact model of relative smoothness and strong convexity is introduced by the authors. The authors demonstrate that the proposed method can converge to the optimal solution at the linear rate and achieve the optimal gradient computation complexity and the near optimal communication complexity, where κg denotes the global condition number. Finally, the numerical experiments are provided to validate the theoretical results and further show the efficacy of the proposed method.
期刊介绍:
IET Signal Processing publishes research on a diverse range of signal processing and machine learning topics, covering a variety of applications, disciplines, modalities, and techniques in detection, estimation, inference, and classification problems. The research published includes advances in algorithm design for the analysis of single and high-multi-dimensional data, sparsity, linear and non-linear systems, recursive and non-recursive digital filters and multi-rate filter banks, as well a range of topics that span from sensor array processing, deep convolutional neural network based approaches to the application of chaos theory, and far more.
Topics covered by scope include, but are not limited to:
advances in single and multi-dimensional filter design and implementation
linear and nonlinear, fixed and adaptive digital filters and multirate filter banks
statistical signal processing techniques and analysis
classical, parametric and higher order spectral analysis
signal transformation and compression techniques, including time-frequency analysis
system modelling and adaptive identification techniques
machine learning based approaches to signal processing
Bayesian methods for signal processing, including Monte-Carlo Markov-chain and particle filtering techniques
theory and application of blind and semi-blind signal separation techniques
signal processing techniques for analysis, enhancement, coding, synthesis and recognition of speech signals
direction-finding and beamforming techniques for audio and electromagnetic signals
analysis techniques for biomedical signals
baseband signal processing techniques for transmission and reception of communication signals
signal processing techniques for data hiding and audio watermarking
sparse signal processing and compressive sensing
Special Issue Call for Papers:
Intelligent Deep Fuzzy Model for Signal Processing - https://digital-library.theiet.org/files/IET_SPR_CFP_IDFMSP.pdf