Shannon's equation specifies the quantity of an information stream produced by an ergodic source. It is given with

$ H = - K\sum\limits_{i = 1}^n {p_i ld(p_i )} $.

p denotes the probability of the associated event, H is referred to as the entropy of the information source.


  • Shannon, W. Weaver, The Mathematical Theory of Communication, University of Illinois Press, 1963, ISBN 0252725484