Entropy and Redundancy
Redundancy is not totally unnecessary and undesirable, but is potential information. Three kinds of redundancy:
Syntactic redundancy: refers to the seemingly superfluous signs using in a message since we have already known the rules, grammars, and structures.( e.g., the sign ’info.’ can be understood equally as the sign ’information’, hence the using of sign ’rmation’ in this case is syntactic redundancy).
Semantic redundancy: is most easily described by the use of synonyms or extra paragraphs for the same thing to make the meaning more clear and avoid misunderstanding.
Pragmatic redundancy: is defined as the percentage of letters, words, etc. that can be removed from the receiver’s message without changing his response.