A Mathematical Theory of Communication
1948 scholarly article by Claude Shannon
- 2 min read
- 2 chapters
Related on Lably
Through Transistor and Signal
It is also noted that "as did relativity and quantum theory, information theory radically changed the way scientists look at the universe". The paper also formally introduced the term "bit" and serves as its theoretical foundation.
Publication
The article was the founding work of the field of information theory. It was later published in 1949 as a book titled The Mathematical Theory of Communication (ISBN 0-252-72546-8), which was published as a paperback in 1963 (ISBN 0-252-72548-4). The book contains an additional article by Warren Weaver, providing an overview of the theory for a more general audience.
Sign in to keep reading
One more chapter is free with a Lably account.
Contents
This work is known for introducing the concepts of channel capacity as well as the noisy channel coding theorem.
Shannon's article laid out the basic elements of communication:
- An information source that produces a message
- A transmitter that operates on the message to create a signal which can be sent through a channel
- A channel, which is the medium over which the signal, carrying the information that composes the message, is sent
- A receiver, which transforms the signal back into the message intended for delivery
- A destination, which can be a person or a machine, for whom or which the message is intended
It also developed the concepts of information entropy, redundancy and the source coding theorem, and introduced the term bit (which Shannon credited to John Tukey) as a unit of information. It was also in this paper that the Shannon–Fano coding technique was proposed – a technique developed in conjunction with Robert Fano.