-
Consider making open-ai-key and hf-token as optional for running readme-ready cli, since these variables are useful only for openAI models; and the main objective of this tool is to to support open-so…
-
### What happened?
Dear litellm developers,
we recently found that when using litellm's `Router` and passing an `api_key` via `litellm_params` it may be leaked when anything with the model call …
-
Error occurred when executing ChatGPT Simple _O:
You tried to access openai.ChatCompletion, but this is no longer supported in openai>=1.0.0 - see the README at https://github.com/openai/openai-pyt…
-
When serving as the LLM provider for GraphRAG, the 100% single CPU usage is preventing full utilization of multiple GPU resources on the server.
 and turn it into a working plugin.
-
I'm trying to use other models besides openai in your example code but I'm just getting a response back "invalid model". I've only tried with anthropic and perplexity so haven't set any of the other m…
-
### Your current environment
```text
Collecting environment information...
PyTorch version: N/A
Is debug build: N/A
CUDA used to build PyTorch: N/A
ROCM used to build PyTorch: N/A
OS: Ubuntu …