{"title":"Coding for constant-data-rate systems","authors":"R. A. Silverman, M. Balser","doi":"10.1109/TIT.1954.1057466","DOIUrl":"https://doi.org/10.1109/TIT.1954.1057466","url":null,"abstract":"","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1954-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131047165","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The human use of information-II: Signal detection for the case of an unknown signal parameter","authors":"W. P. Tanner, R. Z. Norman","doi":"10.1109/TIT.1954.1057462","DOIUrl":"https://doi.org/10.1109/TIT.1954.1057462","url":null,"abstract":"Two specific cases of signal detection involving uncertainty in the frequency of a sound signal are compared with the case of the signal-known-exactly. In the first case the signal is either of two known frequencies; in the second case the signal is any frequency within a given range. It is suggested that detection behavior that is optimal for the three cases requires a deal mechanism: a combination of a wide-open receiver end a panoramic receiver. Evidence is presented that supports the existence of such a mechanism. Estimates of the bandwidth end seen-rate of the receiver are included.","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1954-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114190578","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A new basic theorem of information theory","authors":"A. Feinstein","doi":"10.1109/TIT.1954.1057459","DOIUrl":"https://doi.org/10.1109/TIT.1954.1057459","url":null,"abstract":"\"June 1, 1954.\" \"This report is identical with a thesis submitted to the Department of Physics, M.I.T., ... for the degree of Doctor of Philosophy.\"","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1954-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122265461","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Modern statistical approaches to reception in communication theory","authors":"D. V. Meter, D. Middleton","doi":"10.1109/TIT.1954.1057471","DOIUrl":"https://doi.org/10.1109/TIT.1954.1057471","url":null,"abstract":"When reception in the theory of communication is recognized as a problem in statistical inference, system design and system analysis appear as the counterparts of designing and evaluating statistical tests. This paper discusses the optimum properties of designs based on statistical decision theory from the risk point of view, and from that of information theory. Connections between risk and information loss are established, which result in a unified theory of system design. This includes Minimax methods capable in principle of handling all degrees of a priori knowledge of signal and noise statistics, new methods for comparing actual and ideal systems for the same purpose, and new interpretations of previously used formulations as special cases of the more general theory. Both detection and extraction of signals in noise are considered, the former as a problem of testing statistical hypotheses and the latter as one of estimating parameters. Formulation of the general reception problem as a decision operation is followed by a summary of statistical decision theory from the risk point of view, with some examples of Bayes and Minimax tests and optimum classes of decision rules. Applications to detection show the optimum nature of likelihood ratio receivers as a class, and indicate methods for defining the minimum detectable signal and for comparing system performance. As an illustration, curves of Bayes and Minimax risk are given for detection of a pulsed carrier in noise. Applications to extraction show the nature of optimum extraction and the roles of the mean square error and maximum likelihood criteria from the more general point of view of risk theory. Conditions under which information loss is an extremum in detection and extraction are established, and information loss itself as a criterion of performance is compared with that of the risk measure.","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"50 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1954-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134483633","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Choice and coding in information retrieval systems","authors":"C. Mooers","doi":"10.1109/TIT.1954.1057470","DOIUrl":"https://doi.org/10.1109/TIT.1954.1057470","url":null,"abstract":"","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1954-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114341726","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Error-free Coding","authors":"P. Elias","doi":"10.1109/TIT.1954.1057464","DOIUrl":"https://doi.org/10.1109/TIT.1954.1057464","url":null,"abstract":"","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1954-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128562305","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Estimation of signal parameters in the presence of noise","authors":"D. Slepian","doi":"10.1109/IREPGIT.1954.6373401","DOIUrl":"https://doi.org/10.1109/IREPGIT.1954.6373401","url":null,"abstract":"This paper is concerned with certain applications of the estimation theory of Fisher and Cramer[1] to the problem of estimating signal parameters in the presence of noise. Specifically, the situation to be treated is as follows. A received signal","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1954-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117038733","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Application of linear graphs to communication problems","authors":"A. Laemmel","doi":"10.1109/IREPGIT.1954.6373406","DOIUrl":"https://doi.org/10.1109/IREPGIT.1954.6373406","url":null,"abstract":"Codes have been discussed recently in connection with signal compression and noise reduction in communication theory, and they are here defined as transformations between two time series of discrete symbols. The electronic apparatus which performs the transformation, or any part of the apparatus, can be described by a linear graph which represents transitions between different memory-states. It will be shown how these graphs can be used to systematically classify codes, combine different blocks of apparatus, examine synchronism of decoding apparatus, etc. Linear graphs have been studied as mathematical systems in connection with topology, Markov chains, and electrical network theory; hence there is already much theory which might be profitably applied to communication problems.","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1954-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131395182","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Statistically almost optimum nonlinear network design","authors":"O. Smith","doi":"10.1109/IREPGIT.1954.6373404","DOIUrl":"https://doi.org/10.1109/IREPGIT.1954.6373404","url":null,"abstract":"The statistically-optimum unstable filter to separate desired signals from noise and other undesired signals is shown to take the form of a high gain amplifier, with several output channels, each one of which computes the best statistical measure of one of the signals or the noise. The sum of these outputs comprises a negative feedback circuit. The imposition of the requirement of stability on the overall system is shown to be the same as the imposition of stability on each component plus a small correction in the zero locations. The addition of nonlinear components follows from differences in the amplitude probability distributions. The methods of automatically compensating for the unalterable dynamic characteristics of the output device, of the high gain amplifier, and for changes in the ratio of signal to noise power, are shown. The information needed for this design is the power density spectrum or autocorrelation function of each signal and noise, and the amplitude probability distribution of each. The mechanics of the design are quite simple, and can be done with only a conventional knowledge of circuit theory. A new philosophy of statistically optimum systems is formulated, which embraces both linear and nonlinear systems, and eliminates the necessity of minimizing the error power.","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1954-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127084583","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The detectability of random signals in the presence of noise","authors":"R. Davis","doi":"10.1109/IREPGIT.1954.6373399","DOIUrl":"https://doi.org/10.1109/IREPGIT.1954.6373399","url":null,"abstract":"This morning you have heard excellent presentations of two fields of endeavor, the results and techniques of which could be basic to a statistical theory of communication engineering. On the one hand, the field of statistical inference, as applied to discrete stochastic processes, has developed to a refined point due to the efforts of many statisticians. ��� The work of the late Professor Wald in his successful application of Von Neumann's game theory to the construction of a general theory of decision functions has played a dominant role in the development of these refinements. On the other hand, the theory of stochastic processes depending upon a discrete or continuous time parameter has been developed during the last three deoades by various mathematicians, only during the last few years has the study of statistical inference problems for continuous stochastic processes received much attention. Here the outstanding contribution is the thesis of Ulf Grenander, published in the Arkiv f��r matematik, Band 1, H��fte 3, 1950. In attempting to apply the techniques of statistical inference to continuous processes, it is evident that the central problem is to obtain a coordinate system for the process which allows one to actually carry out. the computations called for by various statistical methods. As far as I am aware, there are at present only two types of continuous stochastic processes for which a coordinate system has been obtained with which one can carry through some of the computations necessary in the testing of statistical hypotheses. One process is a projection on to the real axis of a finite dimensional Markoff process, Gaussian or non Gaussian. The other process is a Gaussian process with a continuous covariance function. The restriction of a continuous covariance function is not serious, since this property applies to all of the stochastic models which have been set up to study continuous processes occurring in communication engineering. (The assumption that the spectrum of a process is a \"pure white noise\" is not consistent with continuity of the covariance function, but a pure white noise is merely a mathematical idealization. The process with a flat band limited spectrum ��� a model often used in application ��� does possess a continuous covariance function.) On the other hand, the restriction to Gaussian processes is one which would be desirable to remove in some cases.","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"67 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1954-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122401558","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}