{"title":"On scalable coding in the presence of decoder side information","authors":"E. Akyol, U. Mitra, E. Tuncel, K. Rose","doi":"10.1109/ISIT.2014.6875194","DOIUrl":"https://doi.org/10.1109/ISIT.2014.6875194","url":null,"abstract":"The problem of scalable coding while exploiting the decoder side information is considered. Prior work considered the two important cases concerning the degraded side information where source X and the side information variables (Y1, Y2) form a Markov chain in the order of either X - Y1 - Y2 or X - Y2 - Y1. While the encoding schemes for these settings differ considerably, they are both based on the combination of conditional codebook encoding, a standard tool in scalable coding, and random binning, conventionally used in decoder side information problems. In this paper, an encoding scheme is proposed solely on the basis of random binning, which essentially performs scalable and Wyner-Ziv coding simultaneously. Proposed scheme achieves the rate-distortion regions of prior results. A practical advantage of the unifying scheme is the fact that random binning can be realized via practical tools such as nested lattice codes and channel codes. Finally, motivated by the proposed encoding scheme, a network interpretation of scalable coding is considered. An achievable region is derived for this problem setting and the potential benefits of networked scalable coding are shown.","PeriodicalId":127191,"journal":{"name":"2014 IEEE International Symposium on Information Theory","volume":"110 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129876818","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The feedback capacity of a class of finite state multiple access channels","authors":"Jui Wu, A. Anastasopoulos","doi":"10.1109/ISIT.2014.6875372","DOIUrl":"https://doi.org/10.1109/ISIT.2014.6875372","url":null,"abstract":"For the discrete memoryless (DM) multiple access channel (MAC) with noiseless feedback Cover and Leung (CL) provided an achievable region that was later shown by Willems to be the capacity region for a special class of channels.","PeriodicalId":127191,"journal":{"name":"2014 IEEE International Symposium on Information Theory","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129896496","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Orthogonal designs optimize achievable dispersion for coherent MISO channels","authors":"Austin Collins, Yury Polyanskiy","doi":"10.1109/ISIT.2014.6875289","DOIUrl":"https://doi.org/10.1109/ISIT.2014.6875289","url":null,"abstract":"This work addresses the question of finite block-length fundamental limits of coherently demodulated multi-antenna channels, subject to frequency non-selective isotropic fading. Specifically we present achievability bound for the channel dispersion - a quantity known to determine the delay required to achieve capacity. It is shown that a commonly used isotropic Gaussian input, which is only one of many possible capacity achieving distributions, is suboptimal. Optimal inputs minimizing channel dispersion turn out to include a family of modulation techniques known as orthogonal designs (in particular, Alamouti's scheme). For 8 transmit antennas numerical evaluation shows that up to 40% of additional penalty in delay is incurred by using isotropic codewords (compared to dispersion-optimal architecture exploiting transmit diversity).","PeriodicalId":127191,"journal":{"name":"2014 IEEE International Symposium on Information Theory","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128568538","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Lossless coding of correlated sources with actions in acyclic directed networks","authors":"Oron Sabag, H. Permuter, A. Cohen","doi":"10.1109/ISIT.2014.6875049","DOIUrl":"https://doi.org/10.1109/ISIT.2014.6875049","url":null,"abstract":"This work studies the problem of distributed compression of correlated sources with an action-dependent joint distribution. This class of problems are in fact extensions of the Slepian-Wolf model, but where cost-constrained actions affect the generation of one of the sources. A network setup is investigated for the case where actions are taken at the encoder. The first source is available at a node in the network, this node can take actions which affect the generation of the other source which is available at different node in the network. Transmission occurs over a general, acyclic, directed network and both sources are required in a set of terminal nodes. The purpose of this work is to study the implications of actions on the set of achievable rates. For this network, generalized cut-set bounds are derived, and a full characterization of the set of achievable rates using single-letter expressions is provided, showing how actions affect the achievable region in a non-trivial manner. Random linear network coding is proved to be optimal in this setup, even though this is not a classical multicast problem. As a special case of this network we study a multi-user setup with two encoders and one decoder, each source is available to one encoder and transmission occurs over rate-limited link. The optimal rate region for this case is characterized, and calculated for a binary example.","PeriodicalId":127191,"journal":{"name":"2014 IEEE International Symposium on Information Theory","volume":"73 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127383890","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Spatio-temporal graphical models for extreme events","authors":"Han Yu, Liaofan Zhang, J. Dauwels","doi":"10.1109/ISIT.2014.6875190","DOIUrl":"https://doi.org/10.1109/ISIT.2014.6875190","url":null,"abstract":"We propose a novel statistical model to describe spatio-temporal extreme events. The model can be used to estimate extreme-value temporal pattern such as seasonality and trend, and further to predict the distribution of extreme events in the future. The basic idea is to explore graphical models to capture the highly structured dependencies among extreme events measured in time and space. More explicitly, we first assume the single observation at each location and time point follows a Generalized Extreme Value (GEV) distribution. The spatio-temporal dependencies are further encoded via graphical models imposed on the GEV parameters. We develop efficient learning and inference algorithms for the resulting non-Gaussian graphical model. Results of both synthetic and real data demonstrate the effectiveness of the proposed approach.","PeriodicalId":127191,"journal":{"name":"2014 IEEE International Symposium on Information Theory","volume":"142 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127504655","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"New upper bounds for grain-correcting and grain-detecting codes","authors":"A. Sharov, R. Roth","doi":"10.1109/ISIT.2014.6875007","DOIUrl":"https://doi.org/10.1109/ISIT.2014.6875007","url":null,"abstract":"New upper bounds on the size and the rate of grain-correcting codes are presented. The new upper bound on the size of t-grain-correcting codes of length n improves on the best known upper bounds for certain values of n and t, whereas the new upper bound on the asymptotic rate of [τn]-grain-correcting codes of length n improves on the previously known upper bounds on the interval τ ∈ (0, ⅛]. A lower bound of 1/2 log2 n on the minimum redundancy of ∞-grain-detecting codes of length n is presented.","PeriodicalId":127191,"journal":{"name":"2014 IEEE International Symposium on Information Theory","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129071263","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jayadev Acharya, Hirakendu Das, O. Milenkovic, A. Orlitsky, Shengjun Pan
{"title":"Quadratic-backtracking algorithm for string reconstruction from substring compositions","authors":"Jayadev Acharya, Hirakendu Das, O. Milenkovic, A. Orlitsky, Shengjun Pan","doi":"10.1109/ISIT.2014.6875042","DOIUrl":"https://doi.org/10.1109/ISIT.2014.6875042","url":null,"abstract":"Motivated by the problem of deducing the structure of proteins using mass-spectrometry, we study the reconstruction of a string from the multiset of its substring compositions. We specialize the backtracking algorithm used for the more general turnpike problem for string reconstruction. Employing well known results about transience of random walks in ≥ 3 dimensions, we show that the algorithm reconstructs random strings over alphabet size ≥ 4 with high probability in near-optimal quadratic time.","PeriodicalId":127191,"journal":{"name":"2014 IEEE International Symposium on Information Theory","volume":"26 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132520415","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Revisiting the Slepian-Wolf coding problem for general sources: A direct approach","authors":"T. Uyematsu, Tetsunao Matsuta","doi":"10.1109/ISIT.2014.6875050","DOIUrl":"https://doi.org/10.1109/ISIT.2014.6875050","url":null,"abstract":"This paper clarifies the ε-achievable rate region of the Slepian-Wolf (SW) coding problem for general sources. We propose new upper and lower bounds on the error probability of the SW coding system for finite block lengths. The proposed bounds are mathematically simple and characterized by an optimization problem on the subset of pairs of output sequences which is closely related to the smooth max-entropy, and are tighter than those obtained by Han. By using these bounds, we clarify the ε-achievable rate region. Further, we also show outer and inner bounds on the ε-achievable rate region in terms of the smooth max-entropy. These two bounds coincide when the error probability vanishes.","PeriodicalId":127191,"journal":{"name":"2014 IEEE International Symposium on Information Theory","volume":"55 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132072573","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A new achievability scheme for downlink multicell processing with finite backhaul capacity","authors":"Nan Liu, Wei Kang","doi":"10.1109/ISIT.2014.6874984","DOIUrl":"https://doi.org/10.1109/ISIT.2014.6874984","url":null,"abstract":"In the scenario of downlink multicell processing, for the case of two base stations and two mobile users, by viewing the problem as a multiple access diamond channel with two destinations, we propose an achievability scheme that combines both the achievability of correlated codewords into the multiple access channel and Marton's achievability for the general broadcast channel. Compared with previously known schemes, our scheme focuses more on exploiting the gain of correlation between the transmitted signals of the base stations. We demonstrate through examples that our proposed scheme outperforms known achievability schemes when the capacities of the backhaul links are in the medium range.","PeriodicalId":127191,"journal":{"name":"2014 IEEE International Symposium on Information Theory","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130280552","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Early decoding for transmission over finite transport blocks","authors":"Cenk Sahin, Lingjia Liu, E. Perrins","doi":"10.1109/ISIT.2014.6875095","DOIUrl":"https://doi.org/10.1109/ISIT.2014.6875095","url":null,"abstract":"Future wireless communications will face the dual challenge of supporting large traffic volume while providing reliable service for various kinds of delay-sensitive traffic. In the light of this challenge, this paper investigates the throughput performance of wireless systems under channel coding over finite transport blocks (TBs) with the channel state sequence available only at the receiver. We analyze the performance of a communication scheme with feedback, namely early decoding, where for each codeblock the receiver makes a single decoding attempt at a time determined based on the available channel state information. A finite-state Markov channel (FSMC) is introduced to model the TB-based wireless system where the parameters of the model are linked to the characteristics of the underlying physical channel. The FSMC model is then used to assess the maximum achievable throughput of the early decoding strategy. Numerical results suggest that despite its low computational complexity the proposed scheme significantly reduces the coding latency to achieve rates near the channel capacity.","PeriodicalId":127191,"journal":{"name":"2014 IEEE International Symposium on Information Theory","volume":"133 46","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131745550","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}