information theory

Table of Contents

Introduction
Historical background
Classical information theory
- Shannon’s communication model
- Four types of communication
  - Discrete, noiseless communication and the concept of entropy
    - From message alphabet to signal alphabet
    - Some practical encoding/decoding questions
    - Entropy
  - Discrete, noisy communication and the problem of error
  - Continuous communication and the problem of bandwidth
Applications of information theory
- Data compression
- Error-correcting and error-detecting codes
- Cryptology
- Linguistics
- Algorithmic information theory
- Physiology
- Physics

References & Edit History Quick Facts & Related Topics

Images

Shannon's communication model

binary symmetric channel

Fourier analysis

communication: noise

For Students

information theory summary

Discover

Close up of books. Stack of books, pile of books, literature, reading. Homepage 2010, arts and entertainment, history and society

12 Novels Considered the “Greatest Book Ever Written”

earthquake. Heavily damaged school in the town of Yingxiu after a major earthquake struck China's Sichuan Province on May 12, 2008.

The 6 Deadliest Earthquakes Since 1950

Mona Lisa, oil on wood panel by Leonardo da Vinci, c. 1503-06; in the Louvre, Paris, France. 77 x 53 cm.

Why Is the Mona Lisa So Famous?

Los Angeles Police Department wanted flyer on Elizabeth Short, aka the "Black Dahlia," who was brutally murdered in January 1947. The FBI supported the Los Angeles Police Department in the case, including by identifying Short through her fingerprints that

America’s 5 Most Notorious Cold Cases (Including One You May Have Thought Was Already Solved)

Orange basketball on black background and with low key lighting. Homepage 2010, arts and entertainment, history and society

The 10 Greatest Basketball Players of All Time

The Cheshire Cat is a fictional cat from Lewis Carroll's Alice's Adventures in Wonderland. (Alice in Wonderland)

11 Banned Books Through Time

Baseball laying in the grass. Homepage blog 2010, arts and entertainment, history and society, sports and games athletics

10 Greatest Baseball Players of All Time

information theory: Facts & Related Content

Written and fact-checked by The Information Architects of Encyclopaedia Britannica

Facts

Also Known As	communication theory

Photos

Shannon's communication model

binary symmetric channel

Fourier analysis

communication: noise

See All Images →

Topics

Shannon-Weaver information theory negative entropy redundancy information processor entropy cryptology information processing communication cybernetics information analysis probability theory computer science combinatorics algebra statistics geometry automata theory set theory trigonometry

Dig Deeper: More Articles That Discuss This Topic

Key People

Claude Shannon

American engineer

Harry Nyquist

American physicist

Blackwell, David

David Blackwell

American statistician and mathematician

Quiz

Equations written on blackboard

Numbers and Mathematics