Solomonoff Induction

The Incomputability of Simple Learning

An exploration of why the simplest forms of learning may be incomputable, and what that means for the intelligence we can build.

Marcus Hutter on Universal Intelligence and Solomonoff Induction

Notes

Technical talk touching on universal induction and AI foundations.

Marcus Hutter: Universal Artificial Intelligence, AIXI, and AGI

Notes

Lecture on AIXI and universal intelligence theory with deep insights.

Universal Artificial Intelligence: Sequential Decisions Based on Algorithmic Probability

Notes

Formal theory of universal agents combining Solomonoff induction and sequential decision theory; foundational for AGI theory.

All Induction Is the Same Induction

Solomonoff induction, MDL, speed priors, and neural networks are all special cases of one Bayesian framework with four knobs.

Approximations of Solomonoff Induction

I experiment with simple predictive / generative models to approximate Solomonoff induction for a relatively simple synthetic data-generating process.