{"title":"Mlnimum-cost encoding of information","authors":"N. Blachman","doi":"10.1109/IREPGIT.1954.6373407","DOIUrl":null,"url":null,"abstract":"Haying determined a cost in energy, time, or money of transmitting each of a set of symbols (e.g., dot and dash, pulses of various amplitudes, etc.), one may inquire as to the nature of a code using these symbols which will transmit a given amount of information at the least cost, or will transmit information at a given rate for the least cost per unit time. Such a code must use each symbol with a relative frequency given by a negative exponential of a linear combination of its cost and duration in the case of a noiseless communication channel. If noise is present, the cost of each symbol is effectively increased by a multiple of its \"prevarication,\" i.e., the entropy of the received symbol when only the given symbol is transmitted.","PeriodicalId":134468,"journal":{"name":"Trans. IRE Prof. Group Inf. Theory","volume":"55 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"1954-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"12","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Trans. IRE Prof. Group Inf. Theory","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IREPGIT.1954.6373407","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 12
Abstract
Haying determined a cost in energy, time, or money of transmitting each of a set of symbols (e.g., dot and dash, pulses of various amplitudes, etc.), one may inquire as to the nature of a code using these symbols which will transmit a given amount of information at the least cost, or will transmit information at a given rate for the least cost per unit time. Such a code must use each symbol with a relative frequency given by a negative exponential of a linear combination of its cost and duration in the case of a noiseless communication channel. If noise is present, the cost of each symbol is effectively increased by a multiple of its "prevarication," i.e., the entropy of the received symbol when only the given symbol is transmitted.