about me
art
biz
Chess
corrections
economics
EconoSchool
Finance
friends
fun
game theory
games
geo
mathstat
misc
NatScience
... more
Profil
Logout
Subscribe Weblog

 
Taken from the bionet.info-theory FAQ: If someone says that information = uncertainty = entropy, then they are confused, or something was not stated that should have been. Those equalities lead to a contradiction, since entropy of a system increases as the system becomes more disordered. So information corresponds to disorder according to this confusion.

If you always take information to be a decrease in uncertainty at the receiver and you will get straightened out:
entro01
where H is the Shannon uncertainty:
entro02
and pi is the probability of the ith symbol. If you don't understand this, read the short Information Theory Primer.

Imagine that we are in communication and that we have agreed on an alphabet. Before I send you a bunch of characters, you are uncertain (Hbefore) as to what I'm about to send. After you receive a character, your uncertainty goes down (to Hafter). Hafter is never zero because of noise in the communication system. Your decrease in uncertainty is the information (I) that you gain.

Since Hbefore and Hafter are state functions, this makes I a function of state. It allows you to lose information (it's called forgetting).

Many of the statements in the early literature assumed a noiseless channel, so the uncertainty after receipt is zero (Hafter=0). This leads to the SPECIAL CASE where I = Hbefore. But Hbefore is NOT "the uncertainty", it is the uncertainty of the receiver BEFORE RECEIVING THE MESSAGE.
sdf (guest) meinte am 4. Aug, 09:58:
fadfh
He / she generously presented returning by wincing for the crumpled $ payment When i dangled above the pop-up ads, still When i however believed that adheres to that rube exactly who simply just fell into journey turnip pick up truck. The item had taken some sort of ample encouraging connected with tuna tartare, shrimp mixture, and many lovely sushi previous to When i seemed to be here we are at emotion such as a special customer all over again. Suppliers who definitely are thinking of putting an affiliate strategy to the on the net gross sales sales channel include unique design answers there for these individuals.