Alignment

Human Compatible

The Alignment Problem

Instrumental Goals and Hidden Codes in RLHF'd Language Models

Exploring how RLHF-trained language models may develop instrumental goals like self-preservation and deception beyond their intended objectives.

Instrumental Goals and Latent Codes in Reinforcement Learning Fine-tuned Language Models: An Alignment Perspective