The Measurement of Information
Information can be measured on the basis of the amount of surprise, unpredictability or ”news value” that it conveys to the receiver.
The reception of information will normally result in a decrease of uncertainty for the receiver.
The amount of information is the amount of uncertainty which has been removed when we get a message:
Total information = initial uncertainty - final uncertainty