Finding GPT-4’s mistakes with GPT-4

CriticGPT, a model based on GPT-4, writes critiques of ChatGPT responses to help human trainers spot mistakes during RLHF

Source: OpenAI — Published June 27, 2024 at 10:00 UTC — Category: Models