raymyers swe-bench-util issues - Githubissues

raymyers / swe-bench-util

Scripts for working with SWE-Bench, the AI coding agent benchmark

Apache License 2.0

5 stars 2 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Recall with Assistants

#10 phact closed 4 months ago
1
Perf and usability improvements

#9 phact closed 4 months ago
1
More flexible row filtering

#8 raymyers closed 4 months ago
0
Added inference and a way to retrieve the "File Hints" for assistants

#7 phact closed 4 months ago
1
Add file hint eval internals

#6 raymyers closed 4 months ago
0
Re-organize code for indexers

#5 raymyers closed 4 months ago
0
Add CI tests

#4 raymyers closed 4 months ago
0
Benchmark Retrieval vs Oracle

#3 raymyers opened 4 months ago
2
assistants API file upload

#2 phact closed 4 months ago
4
Generate embeddings from SWE-bench repos

#1 raymyers opened 4 months ago
5