Entropy

Elements of Information Theory

Notes

The standard information theory textbook. Entropy, channels, coding.

Orientation Under Pressure

On maintaining direction under entropy, making things as resistance, and the quiet privilege of having any space at all to think beyond survival.

Arithmetic Coding

Arithmetic coding closes the gap between Huffman's per-symbol integer lengths and true entropy. A single number in the unit interval encodes an entire sequence; 32-bit integer arithmetic makes it practical.

Perfect Hashing: Space Bounds, Entropy, and Cryptographic Security

Space bounds, entropy requirements, and cryptographic security properties of perfect hash functions.