search

Portkey-AI / gateway

A Blazing Fast AI Gateway with integrated Guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
https://portkey.ai/features/ai-gateway
MIT License
6k stars 410 forks source link

[Feature] Support Vertex Llama Hosted Model #485

Closed narengogi closed 1 month ago

narengogi commented 2 months ago

What Would You Like to See with the Gateway?

Add support for https://console.cloud.google.com/vertex-ai/publishers/meta/model-garden/llama3-405b-instruct-maas

Context for your Request

No response

Your Twitter/LinkedIn

No response