Can it support SWE-bench Lite task parallelism?

Aider-AI / aider-swe-bench

Harness used to benchmark aider against SWE Bench benchmarks

Apache License 2.0

53 stars 14 forks source link

Open rookielyb opened 4 months ago

rookielyb commented 4 months ago

It takes a lot of time to run it now. Thanks!

paul-gauthier commented 4 months ago

Yes, use --threads 10. Also see --help.

paul-gauthier commented 4 months ago

Sorry. Set the threads variable in the main function.

rookielyb commented 4 months ago

Thanks!

Sorry. Set the threads variable in the main function.

Yes, use --threads 10. Also see --help.

Thanks!

paul-gauthier commented 4 months ago

Sorry again, but I noticed there was a bug that forces threads to be 1. Fixed in f30ac2b0f1d82eb83affc1e82b98cd06125e2bc3.