Large Language Models

Fine-Tuning Tiny LLMs for ElasticSearch DSL

I am creating a tiny LLM for ElasticSearch DSL as a proof of concept.

An Algebraic Framework for Language Model Composition: Unifying Projections, Mixtures, and Constraints

DreamLog: Neural-Symbolic Integration through Compression-Based Learning and Wake-Sleep Cycles

Learning to Prompt in Unknown Environments: A POMDP Framework with Compositional Actions for Large Language Models

The Policy

The Policy

A speculative fiction novel exploring AI alignment, existential risk, and the fundamental tension between optimization and ethics. When a research team develops SIGMA, an advanced AI system designed to optimize human welfare, they must confront an …

Approximations of Solomonoff Induction

I experiment with simple predictive / generative models to approximate Solomonoff induction for a relatively simple synthetic data-generating process.