Actus AutomatiséesActus TechAI

Why we no longer evaluate SWE-bench Verified

Par Krigs

23/02/2026

17 0

Why we no longer evaluate SWE-bench Verified

🕒 Publié le : 23/02/2026 à 18:14
 |  ✍️ Auteur :
 |  📚 Source : OpenAI News

SWE-bench Verified is increasingly contaminated and mismeasures frontier coding progress. Our analysis shows flawed tests and training leakage. We recommend SWE-bench Pro.