M. Prakash, Saurav Talukdar, Sandeep Attree, Sourav Patel, M. Salapaka
{"title":"Distributed Stopping Criterion for Ratio Consensus","authors":"M. Prakash, Saurav Talukdar, Sandeep Attree, Sourav Patel, M. Salapaka","doi":"10.1109/ALLERTON.2018.8635839","DOIUrl":"https://doi.org/10.1109/ALLERTON.2018.8635839","url":null,"abstract":"Distributed averaging of initial conditions held by multiple agents is a well-studied problem in context of networked systems where coordination amongst the agents is of paramount importance. The asymptotic nature of distributed averaging protocols makes it challenging to implement in practical settings as it does not lend itself to a finite-time stopping criterion that can be ascertained distributively. It is important that agents develop the ability to detect on their own when average of the initial conditions of the agents is achieved within some pre-specified tolerance and stop further computations. This article presents a distributed stopping criterion for distributed averaging using ratio consensus on a fixed interconnection topology (captured by a directed or undirected graph). The practical utility of the algorithm is illustrated through simulations.","PeriodicalId":299280,"journal":{"name":"2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130785452","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Probabilistic Clustering using Maximal Matrix Norm Couplings","authors":"David Qiu, A. Makur, Lizhong Zheng","doi":"10.1109/ALLERTON.2018.8635939","DOIUrl":"https://doi.org/10.1109/ALLERTON.2018.8635939","url":null,"abstract":"In this paper, we present a local information theoretic approach to explicitly learn probabilistic clustering of a discrete random variable. Our formulation yields a convex maximization problem for which it is NP-hard to find the global optimum. In order to algorithmically solve this optimization problem, we propose two relaxations that are solved via gradient ascent and alternating maximization. Experiments on the MSR Sentence Completion Challenge, MovieLens 100K, and Reuters21578 datasets demonstrate that our approach is competitive with existing techniques and worthy of further investigation.","PeriodicalId":299280,"journal":{"name":"2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"142 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134101515","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Syed Eqbal Alam, R. Shorten, F. Wirth, Jia Yuan Yu
{"title":"Derandomized Distributed Multi-resource Allocation with Little Communication Overhead","authors":"Syed Eqbal Alam, R. Shorten, F. Wirth, Jia Yuan Yu","doi":"10.1109/ALLERTON.2018.8635929","DOIUrl":"https://doi.org/10.1109/ALLERTON.2018.8635929","url":null,"abstract":"We study a class of distributed optimization problems for multiple shared resource allocation in Internet-connected devices. We propose a derandomized version of an existing stochastic additive-increase and multiplicative-decrease (AIMD) algorithm. The proposed solution uses one bit feedback signal for each resource between the system and the Internet-connected devices and does not require inter-device communication. Additionally, the Internet-connected devices do not compromise their privacy and the solution does not dependent on the number of participating devices. In the system, each Internet-connected device has private cost functions which are strictly convex, twice continuously differentiable and increasing. We show empirically that the long-term average allocations of multiple shared resources converge to optimal allocations and the system achieves minimum social cost. Furthermore, we show that the proposed derandomized AIMD algorithm converges faster than the stochastic AIMD algorithm and both the approaches provide approximately same solutions.","PeriodicalId":299280,"journal":{"name":"2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128227667","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Multi-class Bayes error estimation with a global minimal spanning tree","authors":"S. Y. Sekeh, Brandon Oselio, A. Hero","doi":"10.1109/ALLERTON.2018.8635642","DOIUrl":"https://doi.org/10.1109/ALLERTON.2018.8635642","url":null,"abstract":"Henze-Penrose (HP) divergence has been used in many information theory, statistics and machine learning contexts, including the estimation of two-class Bayes classification error. Previous work has shown HP divergence can be directly estimated using the Friedman-Rafsky (FR) multivariate run test statistic. For the multi-class classification problem, HP divergence can also be used to bound the Bayes error by estimating the sum of pairwise Bayes errors between classes. In situations in which the dataset and number of classes are large, this approach is infeasible. In this paper, we present a new generalized measure that allows us to estimate the Bayes error rate without the need to compute pairwise estimates. We compare our new approach with the pairwise HP bound and the bound proposed by Lin [1], and show that our upper bound on Bayes error is tighter, while also having lower computational complexity.","PeriodicalId":299280,"journal":{"name":"2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134077183","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Caching Broadcast Channel with a Wire and Cache Tapping Adversary of Type II: Multiple Library Files","authors":"Mohamed S. Nafea, A. Yener","doi":"10.1109/ALLERTON.2018.8635931","DOIUrl":"https://doi.org/10.1109/ALLERTON.2018.8635931","url":null,"abstract":"A wiretap model with two receivers equipped with fixed-size cache memories, and a type II adversary is considered. The adversary in this model chooses a subset of symbols to tap into either from cache placement, delivery transmission, or both phases. The legitimate parties do not know the fractions or the positions of the tapped symbols in either phase. For a library of size three files or more, lower and upper bounds on the strong secrecy capacity, i.e., the maximum achievable file rate while keeping the overall library strongly secure, are derived. The strong secrecy capacity is identified for the instance of large tapped subsets. Achievability is established by wiretap coding, security embedding codes, one-time pad keys, and coded caching techniques. The upper bound is constructed by three successive channel transformations.","PeriodicalId":299280,"journal":{"name":"2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"189 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116133732","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Improving Computational Efficiency of Communication for Omniscience and Successive Omniscience","authors":"Ni Ding, P. Sadeghi, T. Rakotoarivelo","doi":"10.1109/ALLERTON.2018.8636087","DOIUrl":"https://doi.org/10.1109/ALLERTON.2018.8636087","url":null,"abstract":"For a group of users in V where everyone observes a component of a discrete multiple random source, the process that users exchange data so as to reach omniscience, the state where everyone recovers the entire source, is called communication for omniscience (CO). We first consider how to improve the existing complexity $O(|V|^{2} mathrm{S}mathrm{F} mathrm{M}(|V|)$ of minimizing the sum of communication rates in CO, where $mathrm{S}mathrm{F} mathrm{M}(|V|)$ denotes the complexity of minimizing a submodular function. We reveal some structured property in an existing coordinate saturation algorithm: the resulting rate vector and the corresponding partition of V are segmented in $alpha$, the estimation of the minimum sum-rate. A parametric (PAR) algorithm is then proposed where, instead of a particular $alpha$, we search the critical points that fully determine the segmented variables for all $alpha$ so that they converge to the solution to the minimum sum-rate problem and the overall complexity reduces to $O(|V|cdot mathrm{S}mathrm{F} mathrm{M}(|V|))$.For the successive omniscience (SO), we consider how to attain local omniscience in some complimentary user subset so that the overall sum-rate for the global omniscience still remains minimum. While the existing algorithm only determines a complimentary user subset in $O (|V| mathrm{S}mathrm{F} mathrm{M}(|V|))$ time, we show that, if a lower bound on the minimum sum-rate is applied to the segmented variables in the PAR algorithm, not only a complimentary subset, but also an optimal rate vector for attaining the local omniscience in it are returned in $O(|V|cdot mathrm{S}mathrm{F} mathrm{M}(|V|))$ time.","PeriodicalId":299280,"journal":{"name":"2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123681635","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Price and Capacity Competition for EV parking with Government Mandates","authors":"Brendan Badia, R. Berry, Ermin Wei","doi":"10.1109/ALLERTON.2018.8635835","DOIUrl":"https://doi.org/10.1109/ALLERTON.2018.8635835","url":null,"abstract":"Increasing focus is being put on expanding the amount of charging infrastructure for electric vehicles (EVs). One tool governments have to induce construction of this infrastructure is through mandates on the number of spots private owners of parking have to convert to include chargers. However, such mandates can impact how parking is priced, the revenue of these firms, parking availability for non-EV cars, and the congestion drivers face while finding parking due to how these private owners may react to it. This paper studies the trade-offs involved in setting a mandate for charging by developing a multi-stage game for the provisioning of parking spots and the subsequent price competition for drivers. Furthermore, we look at different pricing models firms may choose for EV and non-EV drivers and study how this affects the impact of a government mandate.","PeriodicalId":299280,"journal":{"name":"2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"71 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130069138","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Rate-cost tradeoffs in scalar LQG control and tracking with side information","authors":"V. Kostina, B. Hassibi","doi":"10.1109/ALLERTON.2018.8635889","DOIUrl":"https://doi.org/10.1109/ALLERTON.2018.8635889","url":null,"abstract":"Consider a control problem in which a remote controller chooses its control action based on two kinds of information about the system state: the information it receives from the system via a rate-constrained feedback link, and side information - a noisy measurement of the system state it observes directly. The goal of the controller is to minimize a quadratic cost function in the state variables and control signal, known as the linear quadratic regulator (LQR). We study the fundamental tradeoff between the communication rate, the expected cost b and the quality of side information. Due to a separation principle between estimation and control, we focus on the tracking problem, where the goal is to track the system state rather than to control it. We introduce the causal rate-distortion function with side information at the decoder. It is expressed in terms of directed mutual information, and it extends the classical (noncausal) Wyner-Ziv rate-distortion function to real-time tracking problems with causality constraints and memory of the past at both encoder and decoder. We compute that function in the scalar linear Gaussian setting; we draw a link with the Kalman filter; we show that making side information available also at the encoder does not help to improve the optimal tradeoffs.","PeriodicalId":299280,"journal":{"name":"2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127802121","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Alankrita Bhatt, Jiun-Ting Huang, Young-Han Kim, J. Ryu, P. Sen
{"title":"Monte Carlo Methods for Randomized Likelihood Decoding","authors":"Alankrita Bhatt, Jiun-Ting Huang, Young-Han Kim, J. Ryu, P. Sen","doi":"10.1109/ALLERTON.2018.8636049","DOIUrl":"https://doi.org/10.1109/ALLERTON.2018.8636049","url":null,"abstract":"A randomized decoder that generates the message estimate according to the posterior distribution is known to achieve the reliability comparable to that of the maximum a posteriori probability decoder. With a goal of practical implementations of such a randomized decoder, several Monte Carlo techniques, such as rejection sampling, Gibbs sampling, and the Metropolis algorithm, are adapted to the problem of efficient sampling from the posterior distribution. Analytical and experimental results compare the complexity and performance of these Monte Carlo decoders for simple linear codes and the binary symmetric channel.","PeriodicalId":299280,"journal":{"name":"2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129497529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The price of choice: models, paradoxes, and inference for ‘mobility as a service’","authors":"D. Wischik","doi":"10.1109/ALLERTON.2018.8635957","DOIUrl":"https://doi.org/10.1109/ALLERTON.2018.8635957","url":null,"abstract":"A city’s transportation network is made up of subsystems, often under separate management, linked together through the choices made by users. This paper introduces a transport model which combines a discrete choice model of users, with a resource allocation model of a subsystems. This combined model gives a direct economic interpretation of tradeoffs in the system. For example, it tells us how much of a rideshare price is attributable to the cost of running the platform and how much is profit-making. The model can also be used to predict knock-on effects in the style of Braess’s paradox, where an improvement in one part of the network might induce problems in other parts because of selfish choices made by users and by subsystems.","PeriodicalId":299280,"journal":{"name":"2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton)","volume":"56 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124529847","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}