{"title":"Correlation properties of Chebyshev binary/bit sequences","authors":"T. Kohda, A. Tsuneda","doi":"10.1109/ISIT.1994.394894","DOIUrl":"https://doi.org/10.1109/ISIT.1994.394894","url":null,"abstract":"We give simple methods to obtain chaotic binary sequences and theoretically evaluate correlation functions of such sequences based on the ensemble average technique.<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133973512","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Finite-precision source resolvability","authors":"Y. Steinberg, S. Verdú","doi":"10.1109/ISIT.1994.394722","DOIUrl":"https://doi.org/10.1109/ISIT.1994.394722","url":null,"abstract":"The paper studies the minimum randomness necessary for finite precision simulation of a random source. In random process simulation, the objective of the simulator is to approximate a set of desired statistics. To this end, the simulator has access to a source of pure random bits-a random number generator-and the approximation is achieved by properly mapping the output of the random number generator to the alphabet of the approximated process. An important question that arises is what is the number of pure random bits per source output that the most efficient simulation scheme needs in order to produce every sample path of the approximating process. The answer to this question depends on the statistics of the approximated source and on the sense of approximation. If the objective was to produce-with the aid of only pure random bits-exactly the same statistics (distributions) as that of the desired process, then one could only simulate finite alphabet random processes whose statistics admit finite binary representations. For example, an exact simulation of a binary process with irrational probabilities is not feasible, since the number of fair bits per source output required for accurate simulation is infinite.<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128958813","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The resolvability and the capacity of AWGN channels are equal","authors":"Te Sun Han, S. Verdú","doi":"10.1109/ISIT.1994.395078","DOIUrl":"https://doi.org/10.1109/ISIT.1994.395078","url":null,"abstract":"The authors have introduced the new notion of resolvability of a channel, as the dual of the capacity, which is defined as the minimum complexity per input letter needed to generate an input process whose output distribution via the channel arbitrarily accurately approximates any prescribed achievable output distribution. The resolvability thus introduced has revealed a deep relationship between the minimum achievable rate for source coding, the channel capacity, the identification capacity and the problem of random number generation. However, the validity of the proof of the converse for the resolvability formula established by Han and Verdu (see IEEE Trans. on Inform. Theory, vol.39, no.3, p.379, 1993) hinged heavily on the assumption that the input alphabet of the channel is finite. Our main purpose in this paper is to show that we can relax this restriction and to show that the resolvability formula of Han and Verdu continues to hold also for a wide class of channels with continuous input alphabet, including as a special case, additive white Gaussian noise (AWGN) channels with power constraint.<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"100 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121617479","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Bits through queues","authors":"V. Anantharam, S. Verdú","doi":"10.1109/ISIT.1994.394647","DOIUrl":"https://doi.org/10.1109/ISIT.1994.394647","url":null,"abstract":"Considers the following simple communication channel model: an error-free bit pipe leading to a buffer modeled by a single-server queue whose \"packets\" or \"customers\" are single bits. If the service rate is /spl mu/ bits/sec, common wisdom would indicate that the Shannon capacity of this communication link is /spl mu/ bits/sec. As we show in this paper, that intuition is wrong: the answer is actually higher than /spl mu/ bits/sec. How could we possibly transmit information at a rate faster than the service rate? After all, overdriving the queue with an arrival rate higher than p will not do, as the queue will become unstable and its output rate will not be higher than /spl mu/. The capacity is higher than /spl mu/ because information can be encoded into the arrival epochs. A simpler and more fundamental problem, namely the Shannon capacity of the single-server queue, is also considered.<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"93 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134485271","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Asymptotically optimal function estimation by minimum complexity criteria","authors":"A. Barron, Yuhong Yang, Bin Yu","doi":"10.1109/ISIT.1994.394933","DOIUrl":"https://doi.org/10.1109/ISIT.1994.394933","url":null,"abstract":"The minimum description length principle applied to function estimation can yield a criterion of the form log(likelihood)+const/spl middot/m instead of the familiar log(likelihood)+(m/2) log n where m is the number of parameters and n is the sample size. The improved criterion yields minimax optimal rates for redundancy and statistical risk. The analysis suggests an information-theoretic reconciliation of criteria proposed by Rissanen (1983), Schwarz (1978), and Akaike (1973).<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122747583","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"On block coded ARQ schemes cumulating the rejected sequences","authors":"T. Niinomi, T. Matsushima, S. Hirasawa","doi":"10.1109/ISIT.1994.394643","DOIUrl":"https://doi.org/10.1109/ISIT.1994.394643","url":null,"abstract":"We show that the received sequences, which are rejected and not discarded on ARQ schemes, make the next decision with repeat request powerful by a random coding arguments. We first give the ordinary ARQ of the basic algorithm with some criterion, and define the ARQ with cumulating the rejected sequences, which naturally extended from the ordinary one. Then we study the error exponent of decoding the second received sequences under the condition that the first is rejected. We assume the block coded ARQ with noiseless feedback.<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"66 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133413183","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Rates of convergence in the source coding theorem, in empirical quantizer design, and in universal lossy source coding","authors":"T. Linder, G. Lugosi, K. Zeger","doi":"10.1109/ISIT.1994.395069","DOIUrl":"https://doi.org/10.1109/ISIT.1994.395069","url":null,"abstract":"Rates of convergence results are established for vector quantization. Convergence rates are given for an increasing vector dimension and/or an increasing training set size. In particular, the following results are shown for memoryless real valued sources with bounded support at transmission rate R. (1) If a vector quantizer with fixed dimension k is designed to minimize the empirical MSE with respect to m training vectors, then its MSE for the true source converges almost surely to the minimum possible MSE as O(/spl radic/(log m/m)); (2) The MSE of an optimal k-dimensional vector quantizer for the true source converges, as the dimension grows, to the distortion-rate function D(R) as O(/spl radic/(log k/k)); (3) There exists a fixed rate universal lossy source coding scheme whose per letter MSE on n real valued source samples converges almost surely to the distortion-rate function D(R) as O(/spl radic/(log log n/log n)); and (4) Consider a training set of n real valued source samples blocked into vectors of dimension k, and a k-dimensional vector quantizer designed to minimize the empirical MSE with respect to the m=[n/k] training vectors. Then the MSE of this quantizer for the true source converges almost surely to the distortion-rate function D(R) as O(/spl radic/(log log n/log n)), if one chooses k=[1/R(1-/spl epsiv/)(log n)] /spl forall//spl epsiv/ /spl epsiv/(0,1).<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"1667 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129338632","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Variable-rate source coding theorems for stationary nonergodic sources","authors":"M. Effros, P. Chou, R. Gray","doi":"10.1109/ISIT.1994.395006","DOIUrl":"https://doi.org/10.1109/ISIT.1994.395006","url":null,"abstract":"The source coding theorem and its converse imply that the optimal performance theoretically achievable by a fixed- or variable-rate block quantizer on a stationary ergodic source equals the distortion-rate function. While a fixed-rate block code cannot achieve arbitrarily closely the distortion-rate function on an arbitrary stationary nonergodic source, the authors show for the case of Polish alphabets that a variable-rate block code can. They also show that the distortion-rate function of a stationary nonergodic source has a decomposition as the average over points of equal slope on the distortion-rate functions of the source's stationary ergodic components. These results extend earlier finite alphabet results.<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125984516","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A lower bound on the expected length of one-to-one codes","authors":"N. Alon, A. Orlitsky","doi":"10.1109/ISIT.1994.394765","DOIUrl":"https://doi.org/10.1109/ISIT.1994.394765","url":null,"abstract":"Shows that the expected length of any one-to-one encoding of a discrete random variable X is at least H(X)-log (H(X)+1)-log e and that this bound is asymptotically achievable.<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115647002","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Bounds on achievable convergence rates of parameter estimators via universal coding","authors":"N. Merhav","doi":"10.1109/ISIT.1994.394935","DOIUrl":"https://doi.org/10.1109/ISIT.1994.394935","url":null,"abstract":"Lower bounds on achievable convergence rates of parameter estimators towards the true parameter, are derived via universal coding considerations. It is shown that for a parametric class of sources, if there exists a universal lossless code whose redundancy decays sufficiently rapidly, then it induces a limitation on the fastest achievable convergence rate of any parameter estimator, at any value of the true parameter, with a possible exception of a vanishingly small subset of parameter values.<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124123072","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}