Entropy simulation of digital information sources and the effect on information source rates

Abstract

Entropy is defined as a measure of how much information can be retrieved from a message or information sources. In data communications, entropy from information sources is described in the form of bits and closely related to the probability of arriving message to receiver and depends on the period of light spectrum, therefore information source rates affected. The problem faced is how to describe it in visual form. Here the entropy simulation was programmed by using Matlab GUI. The design of entropy simulation program consists of two types. The first type is entropy simulation program of text information as input. The second type is entropy simulation program of voice information as input. The results of both simulation program show that entropy value influenced information source rates. In other words, information source rates will increase with the increasing of entropy value.