-
First: We ❤️ LiteLLM
I wish it supported the new Gemini context caching:
https://ai.google.dev/gemini-api/docs/caching?lang=python
I admit I haven't thought the API through well, si…
-
Hi team,
I am trying to use context caching in Gemini through vertexai, however, when trying to create the content to cache, it fails as it can't find the stable model.
I can see that context c…
-
Trying out a few ollama models. But they fail with
`Model "ollama/qwen2" does not support tools, but some tools were supplied to generate(). Please call generate() without tools if you would like …
xster updated
1 month ago
-
### The Feature
Mistral just launched on VertexAI - we will need to add support for this + cost tracking
### Motivation, pitch
-
### Twitter / LinkedIn details
_No response_
-
### Description of the bug:
I executed the following code with loaded GEMINI_API_KEY environment variable but recieved error "google.api_core.exceptions.InvalidArgument: 400 Unsupported MIME type…
-
VertexAI PaLM2 Chat https://docs.spring.io/spring-ai/reference/api/clients/vertexai-palm2-chat.html does not support authentication by gcloud (`gcloud auth application-default login`).
I get followi…
-
### The Feature
Would be nice to be able to set a custom `api_base` for vertex_ai_beta.
### Motivation, pitch
This is so I can use Cloudflare AI Gateway.
### Twitter / LinkedIn details
…
-
### Description of the bug:
I'm using firebase_vertexai: ^0.2.2 to generate text from text and a single image.
As long as i pass Gemini a "jpg" image everything is fine, but when i try with a "png…
-
### File Name
None
### What happened?
Hello,
Looks like Gemini 1.5 Pro tool use is completely broken, in the fact it gives some very strange answers. Consider the following code example:
```p…
-
### Description of the bug:
google.api_core.exceptions.InvalidArgument: 400 Invalid or unsupported file uri:
glm.FileData with a uri doesn't seem to work? I need to use Part.from_uri from the ol…