From 67c457a27628213c74412d2b215a3436527e4198 Mon Sep 17 00:00:00 2001 From: Haifeng Ruan <48704330+crhf@users.noreply.github.com> Date: Thu, 21 Nov 2024 23:23:03 +0800 Subject: [PATCH] Update efficacy in README.md --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 4b09b8b3..815d430b 100644 --- a/README.md +++ b/README.md @@ -26,6 +26,7 @@ > This is a public version of the AutoCodeRover project. Check the latest results on our [website](https://autocoderover.dev/). ## 📣 Updates +- [November 21, 2024] AutoCodeRover(v20240620) achieves **46.20%** efficacy on SWE-bench Verified and **24.89%** on full SWE-bench. - [August 14, 2024] On the SWE-bench Verified dataset released by OpenAI, AutoCodeRover(v20240620) achieves **38.40%** efficacy, and AutoCodeRover(v20240408) achieves 28.8% efficacy. More details in the [blog post](https://openai.com/index/introducing-swe-bench-verified/) from OpenAI and [SWE-bench leaderboard](https://www.swebench.com/). - [July 18, 2024] AutoCodeRover now supports a new mode that outputs the list of potential fix locations. - [June 20, 2024] AutoCodeRover(v20240620) now achieves **30.67%** efficacy (pass@1) on SWE-bench-lite!