search

Mirascope / mirascope

LLM abstractions that aren't obstructions
https://mirascope.com/docs
MIT License
741 stars 47 forks source link

Support for Gemini VertexAI Client #410

Closed ramon-prieto closed 1 month ago

ramon-prieto commented 2 months ago

Description

VertexAI provides a custom endpoint for Gemini models. Can we support the vertexai client on Gemini calls

VertexAI also provides a GenerativeModel class with similar behavior to the gemini sourced class.

Alternatively, vertexai uses the same class for accessing custom/open-source models deployed within a GCP project. A seperate vertexai_call would also make sense if we want to enable access to those too and not just gemini

willbakst commented 2 months ago

Yeah I think a separate vertex module is likely the best path forward here.

I'm adding this to the v1.1 milestone.

willbakst commented 1 month ago

This is released in v1.2!