search

hegelai / prompttools

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
http://prompttools.readthedocs.io
Apache License 2.0
2.55k stars 216 forks source link

Support for Google Vertex AI #90

Closed richardguinness closed 8 months ago

richardguinness commented 9 months ago

🚀 The feature

Support for Google's PaLM 2 API is documented, but there's no mention of Google's Vertex AI model support (e.g. chat-bison). Please add support for this.

Motivation, pitch

Google's Vertex AI offerings are appropriate where data isolation is required. We use Vertex AI models internally and would like to use Prompt Tools in conjunction with them

Alternatives

No response

Additional context

No response

NivekT commented 9 months ago

@richardguinness Thank you for opening this issue.

I just added Google Vertex Chat experiment with an usage example.

Let us know if this works for your use case. If you are interested in other types of models (e.g. text, code), let us know or feel free to open a PR to add those.

Note that you will have to install from source until we push a new version of the package.