Claude shannon's contribution

The important feature of Shannon's theory is the concept of entropy, which proves that entropy is equivalent to the uncertainty of information quantity. Entropy was once introduced by Boltzmann in the second law of thermodynamics, which we can understand as the disorder degree of molecular motion. Information entropy has a similar meaning. For example, in Chinese information processing, the static average information entropy of Chinese characters is relatively large, which is 9.65 bits in Chinese and 4.03 bits in English. This shows that Chinese is more complex than English, reflecting that Chinese is rich in meaning and concise in writing, but it is also difficult to deal with. A large information entropy means a large uncertainty. Therefore, we should study deeply and seek a deep breakthrough in Chinese information processing. We can't blindly think that Chinese characters are the most beautiful characters in the world, and thus come to the wrong conclusion that Chinese characters are the easiest to handle.

Shannon clearly defined the amount of information as the reduction of the degree of random uncertainty in the quantitative calculation of information. This shows his understanding of information: information is used to reduce random uncertainty. Or Shannon's inverse definition: information is the increase of certainty. Although Xiannong's concept of information has made great progress than before, it still has limitations. This concept also does not contain the content and value of information, only considers the random uncertainty, and does not fundamentally answer the question of "what is information". In fact, Shannon's initial motivation was to eliminate the noise in the mobile phone. He gave the upper limit of communication speed. This conclusion was first used in telephone, then in optical fiber and now in wireless communication. Today, we can clearly make overseas calls or satellite calls, which is closely related to the improvement of communication channel quality.

This is really too much, just look at the links (afraid, the links will take a long time to review)