search

princeton-nlp / SWE-bench

[ICLR 2024] SWE-bench: Can Language Models Resolve Real-world Github Issues?
https://www.swebench.com
MIT License
2.04k stars 358 forks source link

How to inference without docker? #194

Closed WentaoTan closed 2 months ago

WentaoTan commented 3 months ago

Describe the issue

How to run swe-bench without docker?

Suggest an improvement to documentation

No response

klieret commented 3 months ago

I do not think this is possible anymore.

moresearch commented 3 months ago

I do not think this is possible anymore.

And that is a good thing indeed! (unless you are on openBSD or something of that sort)

john-b-yang commented 2 months ago

Yes, dockerless SWE-bench is not being actively supported anymore. If you would like a dockerless evaluation, the only option would be to go back to an older version of SWE-bench (<=1.0, around this commit).

However, as mentioned by @moresearch, we would strongly recommend running SWE-bench w/ docker.