Information Theory, Inference, and Learning Algorithms

David J.C. MacKay · 2003 · Link

---

Why it matters

One of the rare books that connects:

• information theory and coding,
• Bayesian inference,
• neural nets,
• and pragmatic engineering intuition.

It’s also a great “taste filter”: if you like this book, you probably like careful thinking.