Evaluate against the SWE-bench benchmark

Significant-Gravitas / AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

https://agpt.co

MIT License

166.03k stars 43.96k forks source link

Evaluate against the SWE-bench benchmark #7037

Open kripper opened 5 months ago

kripper commented 5 months ago

Duplicates

[X] I have searched the existing issues

Summary 💡

Evaluate against the SWE-bench benchmark: https://github.com/princeton-nlp/SWE-bench

Examples 🌈

No response

Motivation 🔦

Compare with and learn from other similar open source projects.

github-actions[bot] commented 3 months ago

This issue has automatically been marked as stale because it has not had any activity in the last 50 days. You can unstale it by commenting or removing the label. Otherwise, this issue will be closed in 10 days.

ntindle commented 3 months ago

Unstale