Ray Solomonoff
Foundational paper on algorithmic probability and universal induction. Basis for AIXI.
Recommended Media
A curated collection of books, papers, lectures, and courses that have shaped my thinking about computation, mathematics, intelligence, and the nature of mind.
133
Items
122
Books
107
Completed
AI & Machine Learning
23 itemsCsaba Szepesvári
Free condensed RL theory book; rigorous and compact. Alternative formal RL resource.
An Introduction to Universal Artificial Intelligence
Marcus Hutter, Elliot Catt, David Quarel
Newer textbook presenting AIXI and related universal agent theory with updated structure; suitable after the core UAI book.
Stuart J. Russell, Peter Norvig
Standard AI textbook covering search, logic, probabilistic reasoning, RL, multiagent systems, and more. Canonical comprehensive AI text.
David Barber
Judea Pearl
Complexity-Based Induction Systems: Comparisons and Convergence Theorems
Ray Solomonoff
Later work on convergence properties of Solomonoff induction.
Ian Goodfellow, Yoshua Bengio, Aaron Courville
Deep Learning with Python
François Chollet
Catherine F. Higham, Desmond J. Higham
Perspective of deep learning from applied math. Bridges math with neural nets.
Aston Zhang, Zachary C. Lipton, Mu Li, Alexander J. Smola
Free open-source deep learning book with code and math integrated. Interactive deep learning resource with runnable code.
Douglas R. Hofstadter
Explores analogy and cognition via computational models. Classic work on analogy and cognition modeling.
Douglas Hofstadter
Classic exploration of self-reference, formal systems, and the nature of mind.
Machine Learning: A Probabilistic Perspective
Kevin P. Murphy
Pattern Recognition and Machine Learning
Christopher M. Bishop
Moritz Hardt, Benjamin Recht
Modern graduate ML text with causal inference, decision making, and ML foundations. Accessible free textbook with strong conceptual framing.
Daphne Koller, Nir Friedman
Richard S. Sutton, Andrew G. Barto
Mathematical RL fundamentals (MDPs, value functions, dynamic programming, approximate methods). RL foundational text that bridges theory and practice.
Judea Pearl, Dana Mackenzie
Trevor Hastie, Robert Tibshirani, Jerome Friedman
The Master Algorithm
Pedro Domingos
Andrej Karpathy
Seminal blog post demonstrating the power of character-level RNNs. Shows Shakespeare generation, Wikipedia generation, LaTeX generation, and Linux kernel code generation. The visualizations of LSTM cells are particularly illuminating.
Marcus Hutter
Formal theory of universal agents combining Solomonoff induction and sequential decision theory; foundational for AGI theory.
Mathematics
25 itemsA Book of Abstract Algebra
Charles C. Pinter
A Course in Combinatorics
J.H. van Lint, R.M. Wilson
A First Course in the Numerical Analysis of Differential Equations
Arieh Iserles
Rigorous introduction to the numerical analysis of ODEs, including stability and stiffness.
Abstract Algebra
David S. Dummit, Richard M. Foote
Larry Wasserman
An Introduction to Probability Theory and Its Applications
William Feller
Bayesian Data Analysis
Andrew Gelman, John B. Carlin, Hal S. Stern, David B. Dunson, Aki Vehtari, Donald B. Rubin
Applied Bayesian inference with computing methods. The standard Bayesian statistics reference.
Bartosz Milewski
Stephen Boyd, Lieven Vandenberghe
Functional Analysis
Walter Rudin
Reinhard Diestel
George Pólya
David J.C. MacKay
Introduction to Probability and Mathematical Statistics
Robert V. Hogg, Joseph W. McKean, Allen T. Craig
Rigorous graduate-level probability + statistics; useful for inference and ML foundations.
Sheldon Axler
Abstract, conceptual focus on vector spaces and linear maps. Avoids determinants until the end.
Matrix Analysis
Roger A. Horn, Charles R. Johnson
Comprehensive advanced linear algebra reference.
Nonlinear Dynamics and Chaos
Steven H. Strogatz
Intuition-rich introduction to qualitative behavior of dynamical systems.
Numerical Linear Algebra
Lloyd N. Trefethen, David Bau
Practical matrix computations and numerical realities.
William H. Press, Saul A. Teukolsky, William T. Vetterling, Brian P. Flannery
Broad coverage of numerical algorithms in science and engineering. Classic cross-topic numerical algorithms.
Principles of Mathematical Analysis (Baby Rudin)
Walter Rudin
E.T. Jaynes
Real Analysis
H.L. Royden, Patrick Fitzpatrick
Solving Ordinary Differential Equations I & II
E. Hairer, S.P. Nørsett, G. Wanner
Definitive reference on modern ODE solvers and stiff systems.
Statistical Inference
George Casella, Roger L. Berger
Standard rigorous text on estimation, hypothesis testing, and asymptotic theory.
Topology
James R. Munkres
Computer Science Theory
18 itemsAdvanced Topics in Types and Programming Languages
Benjamin C. Pierce
Alexander Stepanov
Collected notes on programming philosophy. Free PDF.
Algorithms
Robert Sedgewick, Kevin Wayne
An Introduction to Kolmogorov Complexity and Its Applications
Ming Li, Paul Vitányi
The standard comprehensive reference on Kolmogorov complexity. Essential for understanding Solomonoff induction.
Ronald L. Graham, Donald E. Knuth, Oren Patashnik
Blends discrete mathematics with analysis and algorithm design.
Elements of Programming
Alexander Stepanov, Paul McJones
Rigorous foundations of generic programming. Connects algebra and algorithms. Stepanov's magnum opus.
Foundations of Cryptography
Oded Goldreich
From Mathematics to Generic Programming
Alexander Stepanov, Daniel Rose
History of mathematical ideas underlying generic programming. More accessible than EoP.
Thomas H. Cormen, Charles E. Leiserson, Ronald L. Rivest, Clifford Stein
Introduction to Automata Theory, Languages, and Computation
John E. Hopcroft, Rajeev Motwani, Jeffrey D. Ullman
Introduction to Cryptography with Coding Theory
Wade Trappe, Lawrence C. Washington
Michael Sipser
Core computability and complexity theory.
Pearls of Functional Algorithm Design
Richard Bird
Robert Harper
Chris Okasaki
Serious Cryptography
Jean-Philippe Aumasson
Steven S. Skiena
Benjamin C. Pierce
Rationality & Decision Theory
6 itemsStuart Russell
Max Tegmark
Eliezer Yudkowsky
Collected essays on Bayesian rationality and decision theory.
Nick Bostrom
Assessment of long-term risks from advanced AI.
Brian Christian
Daniel Kahneman
Cognitive biases and dual-process reasoning relevant to rationality.
Science Fiction
5 itemsPeter Watts
Hard SF with deep cognitive science and consciousness themes.
Greg Egan
Physics-dense exploration of posthuman intelligence.
Greg Egan
Explores computation, identity, and emulated worlds.
Protector
Larry Niven
Humans are stuck in the 'breeder' phase - Earth is a lost colony. A member of the species in the Protector stage (stronger, smarter, utilitarian) finds humanity and mentors us behind the scenes. Explores what it means to be a child species under the care of a vastly superior intelligence.
Read as a teenager while traveling to and from my construction job. Not the best book technically, but my first real introduction to serious science fiction. I remember visualizing the Protector's many pockets, his pure utilitarian nature, his indifference to human moral judgments - we were like children to him, but he cared for us as we care for our own children. The book shaped how I think about intelligence gradients and paternalistic care.
Stories of Your Life and Others
Ted Chiang
Short fiction with rigorous thought experiments.
Lectures & Videos
7 itemsAlexander Stepanov
18-part lecture series on efficient programming. Covers the intellectual foundations behind STL.
David Silver: Reinforcement Learning Course
David Silver
Comprehensive lecture series covering RL foundations.
Marcus Hutter
Technical talk touching on universal induction and AI foundations.
Marcus Hutter
Lecture on AIXI and universal intelligence theory with deep insights.
Harold Abelson, Gerald Jay Sussman
Classic deep dive into computation, abstraction, interpreters, and languages.
Rich Hickey
Engineer-philosophical talk about the nature of system and language design.
Sean Parent
Classic talk on recognizing algorithmic patterns. 'No raw loops' - shows how rotate solves many problems elegantly.
Other
6 itemsJon Kleinberg, Éva Tardos
Applied Cryptography
Bruce Schneier
Donald E. Knuth
Donald E. Knuth
Donald E. Knuth
Donald E. Knuth