-
I was looking at the logs and saw,
```
24.03.21 23:01:49: root: INFO : /api/token-usage GET
24.03.21 23:01:49: root: DEBUG : /api/token-usage GET - Response: {"token_usage":0}
24.03.21 23:0…
-
It would be very useful to have some Claude 3 benchmarks using SWE-Agent.
![IMG_1200](https://github.com/princeton-nlp/SWE-agent/assets/15776622/a85a74cb-5771-4025-9640-8e3d22d53e9a)
Since Claud…
-
This Async example below works if you cut the number of messages down to, say 4. I've had it work with 6, even. But with 12 async calls to the haiku model, I get the 429 error:
```
RateLimitError:…
-
- [x] This is actually a bug report.
**What Model are you using?**
- [x] Claude 3
**Describe the bug**
`e.attempt_number` doesn't actually exists, the following lines would raise `AttributeE…
-
### Bug Description
When I upgraded to v2.11.3 from v2.9.x
I found that CUSTOM_MODELS does not work, it worked on v2.9.x.
My configuration is
- CUSTOM_MODELS=-all,+gpt-3.5-turbo-0125,+gpt-4-0125…
-
I have managed to run evaluation according to the [tutorial](https://github.com/princeton-nlp/SWE-bench/blob/main/tutorials/evaluation.md) with `swe-bench.json`. But with the lite version of swe-bench…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain.js documentation with the integrated search.
- [X] I used the GitHub search to find a …
-
### Issue
After seeing a "Malformed" error response from Aider, which didn't like Claude's answer, Aider still applied the updates. When Claude immediately sent a second, "corrected" set of update…
-
e.g. using asyncio
Claude API doesn't support batch processing natively
-
### 🥰 Feature Description
Need to complete the list of models for the providers Perplexity and Openrouter
### 🧐 Proposed Solution
Can you please
1- add the 4 sonar models to Perplexity provider as…