Shannon's equation

Shannon's equation specifies the quantity of an information stream produced by an ergodic source. It is given with

$H = - K\sum\limits_{i = 1}^n {p_i ld(p_i )}$.

p denotes the probability of the associated event, H is referred to as the entropy of the information source.

Reference

• Shannon, W. Weaver, The Mathematical Theory of Communication, University of Illinois Press, 1963, ISBN 0252725484