Specific versus General Principles for Constitutional AI

This abstract presents Constitutional AI, an approach replacing human feedback with AI-model feedback guided by written principles to prevent harmful or self-interested behaviors in conversational models. The authors test whether a single general principle (roughly "do what's best for humanity") can produce harmless assistants and find that large dialogue models can generalize from this short constitution, though more detailed constitutions help control specific harms.