-
ValueError: Cannot find the config file for gptq
-
As title.
-
### Description
We have been experiencing regular 429 errors on [POST] /api/chat/mistral, indicating that too many requests are being sent to different services. This issue may be caused by sending m…
-
Hi,
## Disclaimer
I was writing this issue while you answered #105 but now I'm confused as to wether i should post this one or not.
You said:
> Mistran is not supported
and
> don't giv…
-
Python-llama-cpp and OpenRouter.ai are gain traction among llm users for their being able to serve OpenSource models over an OpenAI-like API interface. Personally, I often deploy a local model to a Co…
-
Not sure if I'm missing something, but having some measure of control over sampler settings would be nice. At the minimum, being able to control Top_P and Temperature would make this a lot more usab…
-
### Describe the bug
Their a problem with Autogen with OperRouter. 'NoneType' object has no attribute 'prompt_tokens'
config_list = [
{
"model": "cognitivecomputations/dolphin-mixtra…
-
I'm unfamiliar with OpenRouter here in the LLM code. Any way to add Cohere and OpenAI as options too?
https://github.com/aurelio-labs/semantic-router/blob/main/semantic_router/utils/llm.py
-
### Before Reporting
- [X] I have checked FAQ, and there is no solution to my issue
- [X] I have searched the existing issues, and there is no existing issue for my issue
### What happened?
I'm usi…
-
Aider v0.27.0
Command: `aider --openrouter --model anthropic/claude-3-opus --openai-api-key *****`
```
Traceback (most recent call last):
File "/home/m/.local/bin/aider", line 8, in
sy…