Separating signal from noise in coding evaluations

A new analysis from OpenAI reveals issues in SWE-Bench Pro, a popular coding benchmark, raising concerns about reliability and accuracy in evaluating AI models.

Source: OpenAI — Published July 8, 2026 at 13:00 UTC — Category: Models