Information
From Biomedical Cybernetics
The term information covers signs, signals and messages with their syntactic, semantic and pragmatic aspects.
Uncertainty (and thus information content) of a random event i may be quantitatively described in form of the negative logarithm of its probability with
I = - ld pi
where ld denotes the dual logarithm as ld M = lg M / lg 2 = ln M / ln 2
The quantity of an information stream produced by an ergodic source is given with Shannon's equation as
H = - K Sigma i = 1 n (pi ld pi).
H is referred to as the entropy of the information source.
