Proceedings of 1994 IEEE International Symposium on Information Theory最新文献

筛选
英文 中文
Correlation properties of Chebyshev binary/bit sequences 切比雪夫二进制/位序列的相关特性
Proceedings of 1994 IEEE International Symposium on Information Theory Pub Date : 1994-12-01 DOI: 10.1109/ISIT.1994.394894
T. Kohda, A. Tsuneda
{"title":"Correlation properties of Chebyshev binary/bit sequences","authors":"T. Kohda, A. Tsuneda","doi":"10.1109/ISIT.1994.394894","DOIUrl":"https://doi.org/10.1109/ISIT.1994.394894","url":null,"abstract":"We give simple methods to obtain chaotic binary sequences and theoretically evaluate correlation functions of such sequences based on the ensemble average technique.<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133973512","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Finite-precision source resolvability 有限精度源解析性
Proceedings of 1994 IEEE International Symposium on Information Theory Pub Date : 1994-12-01 DOI: 10.1109/ISIT.1994.394722
Y. Steinberg, S. Verdú
{"title":"Finite-precision source resolvability","authors":"Y. Steinberg, S. Verdú","doi":"10.1109/ISIT.1994.394722","DOIUrl":"https://doi.org/10.1109/ISIT.1994.394722","url":null,"abstract":"The paper studies the minimum randomness necessary for finite precision simulation of a random source. In random process simulation, the objective of the simulator is to approximate a set of desired statistics. To this end, the simulator has access to a source of pure random bits-a random number generator-and the approximation is achieved by properly mapping the output of the random number generator to the alphabet of the approximated process. An important question that arises is what is the number of pure random bits per source output that the most efficient simulation scheme needs in order to produce every sample path of the approximating process. The answer to this question depends on the statistics of the approximated source and on the sense of approximation. If the objective was to produce-with the aid of only pure random bits-exactly the same statistics (distributions) as that of the desired process, then one could only simulate finite alphabet random processes whose statistics admit finite binary representations. For example, an exact simulation of a binary process with irrational probabilities is not feasible, since the number of fair bits per source output required for accurate simulation is infinite.<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128958813","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
The resolvability and the capacity of AWGN channels are equal AWGN信道的可分辨性和容量相等
Proceedings of 1994 IEEE International Symposium on Information Theory Pub Date : 1994-12-01 DOI: 10.1109/ISIT.1994.395078
Te Sun Han, S. Verdú
{"title":"The resolvability and the capacity of AWGN channels are equal","authors":"Te Sun Han, S. Verdú","doi":"10.1109/ISIT.1994.395078","DOIUrl":"https://doi.org/10.1109/ISIT.1994.395078","url":null,"abstract":"The authors have introduced the new notion of resolvability of a channel, as the dual of the capacity, which is defined as the minimum complexity per input letter needed to generate an input process whose output distribution via the channel arbitrarily accurately approximates any prescribed achievable output distribution. The resolvability thus introduced has revealed a deep relationship between the minimum achievable rate for source coding, the channel capacity, the identification capacity and the problem of random number generation. However, the validity of the proof of the converse for the resolvability formula established by Han and Verdu (see IEEE Trans. on Inform. Theory, vol.39, no.3, p.379, 1993) hinged heavily on the assumption that the input alphabet of the channel is finite. Our main purpose in this paper is to show that we can relax this restriction and to show that the resolvability formula of Han and Verdu continues to hold also for a wide class of channels with continuous input alphabet, including as a special case, additive white Gaussian noise (AWGN) channels with power constraint.<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"100 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121617479","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Bits through queues 通过队列的比特
Proceedings of 1994 IEEE International Symposium on Information Theory Pub Date : 1994-12-01 DOI: 10.1109/ISIT.1994.394647
V. Anantharam, S. Verdú
{"title":"Bits through queues","authors":"V. Anantharam, S. Verdú","doi":"10.1109/ISIT.1994.394647","DOIUrl":"https://doi.org/10.1109/ISIT.1994.394647","url":null,"abstract":"Considers the following simple communication channel model: an error-free bit pipe leading to a buffer modeled by a single-server queue whose \"packets\" or \"customers\" are single bits. If the service rate is /spl mu/ bits/sec, common wisdom would indicate that the Shannon capacity of this communication link is /spl mu/ bits/sec. As we show in this paper, that intuition is wrong: the answer is actually higher than /spl mu/ bits/sec. How could we possibly transmit information at a rate faster than the service rate? After all, overdriving the queue with an arrival rate higher than p will not do, as the queue will become unstable and its output rate will not be higher than /spl mu/. The capacity is higher than /spl mu/ because information can be encoded into the arrival epochs. A simpler and more fundamental problem, namely the Shannon capacity of the single-server queue, is also considered.<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"93 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134485271","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 316
Asymptotically optimal function estimation by minimum complexity criteria 基于最小复杂度准则的渐近最优函数估计
Proceedings of 1994 IEEE International Symposium on Information Theory Pub Date : 1994-12-01 DOI: 10.1109/ISIT.1994.394933
A. Barron, Yuhong Yang, Bin Yu
{"title":"Asymptotically optimal function estimation by minimum complexity criteria","authors":"A. Barron, Yuhong Yang, Bin Yu","doi":"10.1109/ISIT.1994.394933","DOIUrl":"https://doi.org/10.1109/ISIT.1994.394933","url":null,"abstract":"The minimum description length principle applied to function estimation can yield a criterion of the form log(likelihood)+const/spl middot/m instead of the familiar log(likelihood)+(m/2) log n where m is the number of parameters and n is the sample size. The improved criterion yields minimax optimal rates for redundancy and statistical risk. The analysis suggests an information-theoretic reconciliation of criteria proposed by Rissanen (1983), Schwarz (1978), and Akaike (1973).<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122747583","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 27
On block coded ARQ schemes cumulating the rejected sequences 在分组编码ARQ方案中累积被拒绝的序列
Proceedings of 1994 IEEE International Symposium on Information Theory Pub Date : 1994-12-01 DOI: 10.1109/ISIT.1994.394643
T. Niinomi, T. Matsushima, S. Hirasawa
{"title":"On block coded ARQ schemes cumulating the rejected sequences","authors":"T. Niinomi, T. Matsushima, S. Hirasawa","doi":"10.1109/ISIT.1994.394643","DOIUrl":"https://doi.org/10.1109/ISIT.1994.394643","url":null,"abstract":"We show that the received sequences, which are rejected and not discarded on ARQ schemes, make the next decision with repeat request powerful by a random coding arguments. We first give the ordinary ARQ of the basic algorithm with some criterion, and define the ARQ with cumulating the rejected sequences, which naturally extended from the ordinary one. Then we study the error exponent of decoding the second received sequences under the condition that the first is rejected. We assume the block coded ARQ with noiseless feedback.<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"66 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133413183","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Rates of convergence in the source coding theorem, in empirical quantizer design, and in universal lossy source coding 源编码定理中的收敛速度,经验量化器设计,以及通用有损源编码
Proceedings of 1994 IEEE International Symposium on Information Theory Pub Date : 1994-11-01 DOI: 10.1109/ISIT.1994.395069
T. Linder, G. Lugosi, K. Zeger
{"title":"Rates of convergence in the source coding theorem, in empirical quantizer design, and in universal lossy source coding","authors":"T. Linder, G. Lugosi, K. Zeger","doi":"10.1109/ISIT.1994.395069","DOIUrl":"https://doi.org/10.1109/ISIT.1994.395069","url":null,"abstract":"Rates of convergence results are established for vector quantization. Convergence rates are given for an increasing vector dimension and/or an increasing training set size. In particular, the following results are shown for memoryless real valued sources with bounded support at transmission rate R. (1) If a vector quantizer with fixed dimension k is designed to minimize the empirical MSE with respect to m training vectors, then its MSE for the true source converges almost surely to the minimum possible MSE as O(/spl radic/(log m/m)); (2) The MSE of an optimal k-dimensional vector quantizer for the true source converges, as the dimension grows, to the distortion-rate function D(R) as O(/spl radic/(log k/k)); (3) There exists a fixed rate universal lossy source coding scheme whose per letter MSE on n real valued source samples converges almost surely to the distortion-rate function D(R) as O(/spl radic/(log log n/log n)); and (4) Consider a training set of n real valued source samples blocked into vectors of dimension k, and a k-dimensional vector quantizer designed to minimize the empirical MSE with respect to the m=[n/k] training vectors. Then the MSE of this quantizer for the true source converges almost surely to the distortion-rate function D(R) as O(/spl radic/(log log n/log n)), if one chooses k=[1/R(1-/spl epsiv/)(log n)] /spl forall//spl epsiv/ /spl epsiv/(0,1).<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"1667 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129338632","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 130
Variable-rate source coding theorems for stationary nonergodic sources 平稳非遍历源的变速率源编码定理
Proceedings of 1994 IEEE International Symposium on Information Theory Pub Date : 1994-11-01 DOI: 10.1109/ISIT.1994.395006
M. Effros, P. Chou, R. Gray
{"title":"Variable-rate source coding theorems for stationary nonergodic sources","authors":"M. Effros, P. Chou, R. Gray","doi":"10.1109/ISIT.1994.395006","DOIUrl":"https://doi.org/10.1109/ISIT.1994.395006","url":null,"abstract":"The source coding theorem and its converse imply that the optimal performance theoretically achievable by a fixed- or variable-rate block quantizer on a stationary ergodic source equals the distortion-rate function. While a fixed-rate block code cannot achieve arbitrarily closely the distortion-rate function on an arbitrary stationary nonergodic source, the authors show for the case of Polish alphabets that a variable-rate block code can. They also show that the distortion-rate function of a stationary nonergodic source has a decomposition as the average over points of equal slope on the distortion-rate functions of the source's stationary ergodic components. These results extend earlier finite alphabet results.<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125984516","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 22
A lower bound on the expected length of one-to-one codes 一对一码的期望长度的下界
Proceedings of 1994 IEEE International Symposium on Information Theory Pub Date : 1994-09-01 DOI: 10.1109/ISIT.1994.394765
N. Alon, A. Orlitsky
{"title":"A lower bound on the expected length of one-to-one codes","authors":"N. Alon, A. Orlitsky","doi":"10.1109/ISIT.1994.394765","DOIUrl":"https://doi.org/10.1109/ISIT.1994.394765","url":null,"abstract":"Shows that the expected length of any one-to-one encoding of a discrete random variable X is at least H(X)-log (H(X)+1)-log e and that this bound is asymptotically achievable.<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115647002","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 53
Bounds on achievable convergence rates of parameter estimators via universal coding 通用编码下参数估计器可实现收敛率的界
Proceedings of 1994 IEEE International Symposium on Information Theory Pub Date : 1994-07-01 DOI: 10.1109/ISIT.1994.394935
N. Merhav
{"title":"Bounds on achievable convergence rates of parameter estimators via universal coding","authors":"N. Merhav","doi":"10.1109/ISIT.1994.394935","DOIUrl":"https://doi.org/10.1109/ISIT.1994.394935","url":null,"abstract":"Lower bounds on achievable convergence rates of parameter estimators towards the true parameter, are derived via universal coding considerations. It is shown that for a parametric class of sources, if there exists a universal lossless code whose redundancy decays sufficiently rapidly, then it induces a limitation on the fastest achievable convergence rate of any parameter estimator, at any value of the true parameter, with a possible exception of a vanishingly small subset of parameter values.<<ETX>>","PeriodicalId":331390,"journal":{"name":"Proceedings of 1994 IEEE International Symposium on Information Theory","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1994-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124123072","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
相关产品
×
本文献相关产品
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信