{"title":"Quantal aspects of scientific information","authors":"D. Mackay","doi":"10.1109/TIT.1953.1188569","DOIUrl":"https://doi.org/10.1109/TIT.1953.1188569","url":null,"abstract":"This paper is an attempt to clarify some aspects of the approach to experimentation suggested by the author in a recent publication in the Philosophical Magazine, (hereafter referred to as P.M.). The concept of \"amount of information\" is shown to have three distinct senses in current literature. Two of these are definable as numerical features of the logical pattern of propositional relations which we make to represent a result. The third measures the relative unexpectedness of the pattern, which may or may not be connected with its numerical features. Since logical patterns can be built up from discrete quantal elements, the information enabling them to be built is quantised by our use of 'yes-or-no' logical forms as scientific statements. The number of discrete 'elementary propositions' in a given description cannot be altered by any complete reformulation. This is seen to be the basis of our ability to 'barter' certain quantities for one another - e.g. accuracy for speed of response in a galvanometer or a communication-channel. The term \"selective information\" is suggested to distinguish the third sense of 'information' (called amount of detail in P.M.) from the first two, whioh measure respectively the number of independent features (structural information) and the weight of evidence or precision (metrical information) in a result. 'Selective information' is the measure of information currently used by communication engineers, and a distinguishing title appears to be essential. From the standpoint here adopted the various uncertainty-relations of physics illustrate a general axiom expressing the quantal nature of the logical descriptions which we make. Some other practical and theoretical implications of the theory are examined.","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1953-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129333007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Information, machines, and brains","authors":"A. M. Uttley","doi":"10.1109/TIT.1953.1188592","DOIUrl":"https://doi.org/10.1109/TIT.1953.1188592","url":null,"abstract":"","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"225 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1953-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130653550","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Fluctuations and theory of noise","authors":"D. MacDonald","doi":"10.1109/TIT.1953.1188561","DOIUrl":"https://doi.org/10.1109/TIT.1953.1188561","url":null,"abstract":"","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"45 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1953-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133192868","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Discussion on Mr. E.C. Cherry's paper on 'On the History of the Theory of Information'","authors":"E. C. Cherry","doi":"10.1109/TIT.1953.1188580","DOIUrl":"https://doi.org/10.1109/TIT.1953.1188580","url":null,"abstract":"","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1953-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128239230","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Discussion on Dr. T. Gold's paper on 'Hearing'","authors":"T. Gold","doi":"10.1109/TIT.1953.1188590","DOIUrl":"https://doi.org/10.1109/TIT.1953.1188590","url":null,"abstract":"","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1953-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129619027","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Communication theory and physics","authors":"D. Gabor","doi":"10.1109/TIT.1953.1188558","DOIUrl":"https://doi.org/10.1109/TIT.1953.1188558","url":null,"abstract":"The electromagnetic signals used in communication are subject to the general laws of radiation. One obtains a complete representation of a signal by dividing the time-frequency plane into cells of unit area and associating with every cell a \"ladder\" of distinguishable steps in signal intensity. The steps are determined by Einstein's law of energy fluctuation, involving both waves and photons. This representation, however, gives only one datum per cell, viz. the energy, while in the classical description one has two data; an amplitude and a phase. It is shown in the second part of the paper that both descriptions are practically equivalent in the long-wave region, or for strong signals, as they contain approximately the same number of independent, distinguishable data, but the classical description is always a little less complete than the quantum description. In the best possible experimental analysis the number of distinguishable steps in the measurement of amplitude and phase is only the fourth root of the number of photons. Thus it takes a hundred million photons per cell in order to define amplitude and phase to one percent each.","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"38 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1953-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130856684","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Discussion on Dr. Gabor's Paper on 'Communication Theory and Physics'","authors":"D. Gabor","doi":"10.1109/TIT.1953.1188582","DOIUrl":"https://doi.org/10.1109/TIT.1953.1188582","url":null,"abstract":"","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1953-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133231692","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Glossary of physiological terms","authors":"J. Bates","doi":"10.1109/TIT.1953.1188574","DOIUrl":"https://doi.org/10.1109/TIT.1953.1188574","url":null,"abstract":"","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1953-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133873999","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The lattice theory of information","authors":"C. Shannon","doi":"10.1109/TIT.1953.1188572","DOIUrl":"https://doi.org/10.1109/TIT.1953.1188572","url":null,"abstract":"The word \"information\" has been given many different meanings by various writers in the general field of information theory. It is likely that at least a number of these will prove sufficiently useful in certain applications to deserve further study and permanent recognition. It is hardly to be expected that a single concept of information would satisfactorily account for the numerous possible applications of this general field. The present note outlines a new approach to information theory which is aimed specifically at the analysis of certain communication problems in which there exist a number of information sources simultaneously in operation. A typical example is that of a simple communication channel with a feedback path from the receiving point to the transmitting point. The problem is to make use of the feedback information for improving forward transmission, and to determine the forward channel capacity when the best possible use is made of this feedback information. Another more general problem is that of a communication system consisting of a large number of transmitting and receiving points with some type of interconnection network between the various points. The problem here is to formulate the best systems design whereby, in some sense, the best overall use of the available facilities is made. While the analysis sketched here has not yet proceeded to the point or a complete solution of these problems, partial answers have been found and it is believed that a complete solution may be possible.","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"32 6","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1953-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114112094","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Communication theory, past, present and prospective","authors":"D. Gabor","doi":"10.1109/TIT.1953.1188571","DOIUrl":"https://doi.org/10.1109/TIT.1953.1188571","url":null,"abstract":"Modern communication theory originated from the attempts of communication engineers to understand what they were doing, in the most general terms. When the mathematical concept of information had crystallized out of these attempts, it was found that a track beaten by theoretical physicists led to the same idea, and, as usual, it was found that pure mathematicians had prepared the way to even more general developments. The new science of information theory thus connects several fields of research, old and new, each with its own techniques.","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1953-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130710544","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}