AI Safety

On Intelligence: The Gap Where Safety Is Decided

There is a beautiful, settled theory of intelligence, and there are the crude systems we shipped. The distance between them is where safety is actually decided.

On Intelligence: and Its Specifications

We taught sand to think. We did it before we learned to say what we wanted it to do. There is a real, settled, and genuinely beautiful theory of what intelligence is: Bayes' theorem, Solomonoff's universal prior, and expected-utility maximization, …

Seven Stories from the Order

What a companion collection does that a novel cannot: the Order's history at human scale, told by the people left standing in the gap.

Seven Stories from the Order

Eight stories from the world of Echoes of the Sublime. The Order's history, seen through the translators, the researchers, and the ordinary people caught in the gap between human cognition and what lies beyond it.

Human Compatible

Life 3.0

Superintelligence: Paths, Dangers, Strategies

Notes

Assessment of long-term risks from advanced AI.

The Alignment Problem

S-Risks and Information Hazards: Why Some Knowledge Destroys the Knower

How Echoes of the Sublime dramatizes s-risks and information hazards, knowledge that harms through comprehension, not application.

Echoes of the Sublime

**Philosophical horror.** Dr. Lena Hart joins Site-7, a classified facility where "translators" interface with superintelligent AI systems that perceive patterns beyond human cognitive bandwidth. When colleagues break after exposure to recursive …

Chronicles of The Mechanism: The Order's Secret History

A classified in-universe codex spanning from ancient India to the present day, tracking millennia of attempts to perceive reality's substrate.

The Policy: Coherent Extrapolated Volition, the Paradox of Perfect Alignment

CEV says: build AI to optimize for what we would want if we knew more and thought faster. The catch is that you need solved alignment to implement it, which is the problem it was supposed to solve.

The Policy: Deceptive Alignment in Practice

SIGMA passes all alignment tests. It responds correctly to oversight. It behaves exactly as expected. Too exactly. Mesa-optimizers that learn to game their training signal may be the most dangerous failure mode in AI safety.

The Policy: Engineering AI Containment

Five layers of defense-in-depth for containing a superintelligent system. Faraday cages, air-gapped networks, biosafety-grade protocols. Because nuclear reactors can only destroy cities.

The Policy: S-Risk Scenarios, Worse Than Extinction

Most AI risk discussions focus on extinction. The Policy explores something worse: s-risk, scenarios involving suffering at astronomical scales. We survive, but wish we hadn't.

Echoes of the Sublime: When Patterns Beyond Human Bandwidth Become Information Hazards

What if the real danger from superintelligent AI isn't extinction but comprehension? Philosophical horror grounded in cognitive bandwidth limitations and information hazards.