Reasoning

Advancing Mathematical Reasoning in AI: Introducing Reverse-Process Synthetic Data Generation

Check out the (early) project and source code on GitHub.

Abstract:

This paper introduces a methodology for generating high-quality, diverse training data for Language Models (LMs) in complex problem-solving domains. Our approach, termed …

Compositional Prompting for LLM Reasoning: A Monte Carlo Tree Search Framework

A new approach to LLM reasoning that combines Monte Carlo Tree Search with structured action spaces for compositional prompting.

MCTS-Reasoning: Tree Search for LLM Reasoning

Applying Monte Carlo Tree Search to large language model reasoning with a rigorous formal specification.