search

paul-gauthier / aider

aider is AI pair programming in your terminal
https://aider.chat/
Apache License 2.0
19.47k stars 1.79k forks source link

how to evaluate aider on swe_bench lite dataset? #726

Closed ramsey-coding closed 3 months ago

ramsey-coding commented 3 months ago

Issue

how can I evaluate aider on swe_bench lite dataset?

Are there documents for replication step?

Version and model info

No response

paul-gauthier commented 3 months ago

Thanks for trying aider and filing this issue. This doc may be helpful:

https://github.com/paul-gauthier/aider-swe-bench

paul-gauthier commented 3 months ago

I'm going to close this issue for now, but feel free to add a comment here and I will re-open or file a new issue any time.