Introducing SWE-bench Verified

We’re releasing a human-validated subset of SWE-bench that more reliably evaluates AI models’ ability to solve real-world software issues.

Source: OpenAI — Published August 13, 2024 at 10:00 UTC — Category: Models