information theory
- Yuki
- Jun 28
- 1 min read
"A theory that mathematically deals with how much information is contained, how accurately it can be transmitted, and how much it can be compressed."
1. Amount of information
The rarer something is, the more information it contains.
2. Entropy
How uncertain is it? How difficult is it to predict?
3. Compression
Information theory is about how much data can be shortened.
4. Communications
How accurately can information be transmitted even with noise?
How well can we organize and convey the meaning, signals, movement patterns, lines of sight, sounds, and light within a space?
Mathematics that treats information as a "quantity" and considers uncertainty, compression, communication, noise, and the transmission of meaning.
Comments