A Set of Linearized Partially-Parallel Splitting Methods for Separable Convex Programs

The proximal partially-parallel splitting method (PPSM), originally proposed in Wang et al. (2017), is a hybrid mechanism that inherits the nice properties of both Gauss-Seidel and Jacobian substitution procedures for solving the multiple-block convex minimization problem, whose objective function is the sum of individual (separable) functions without any shared variables, subject to a linear coupling constraint. In this paper, we extend this work and present some of the PPSM, which fully utilize the separable structure and result in subproblems that either have closed-form solutions or are relatively easy to solve as compared to their original nonlinear versions. Global convergence of these linearized methods under the projection contraction algorithmic framework is proven, and furthermore, detailed remarks that serve to clarify the interconnections between these linearized variants are highlighted. Finally, the worst-case convergence rate of these methods under ergodic conditions is also established.