-
### What happened?
Cannot import litellm on macos Python 3.10.15
Only occurs in 1.52.14, does not occur in 1.52.12
### Relevant log output
```shell
import litellm
--------------------------…
-
I'm using Phoenix to trace LLM calls in a FastAPI application that utilizes LiteLLM. When running the application, LLM calls work correctly, and responses are returned as expected. However, traces are…
-
I attempted to run the `write_a_book_with_flows` example using the `llama3.2 8b` model via Ollama. However, when executing the flow with the command:
```
crewai flow kickoff
```
I encountered …
-
### What happened?
With the v1/realtime endpoint, you are able to call it without a valid api key if `OPENAI_API_KEY` is defined in the Proxy. This is a security vulnerability if you are trying to …
-
Hi @Weves! I'm starting this issue to talk about adding Langfuse integration to Danswer, like we discussed before. Adding Langfuse will make Danswer even better by helping you see how much it costs an…
-
Hey @srush,
saw that you're using manifest for making OpenAI/LLM calls vs. calling it yourself - why is that?
https://github.com/srush/MiniChain/blob/b79ebc51bdedb836c9265eec2fcc21cd60b17327/min…
-
Aider version: 0.62.1
Python version: 3.11.0
Platform: Windows-10-10.0.22631-SP0
Python implementation: CPython
Virtual environment: No
OS: Windows 10 (64bit)
Git version: git version 2.47.0.win…
-
### Description
I am trying to use the dalle-tool with an OpenAI implementation on Azure. The Crewai Agents in my script work well, WebsiteSearchTool works well but dalle-tool demands an OPEN_API_KEY…
-
### What happened?
How to test:
- Setup proxy with a hugging face model, for example codellama/CodeLlama-34b-Instruct-hf and format="json"
- Use a prompt that let's the model return the json, som…
-
### The Feature
To support custom input params for Triton embedding server.
### Motivation, pitch
Currently the input payload params of the Triton Embedding model call is fixed with below for…