-
### What Would You Like to See with the Gateway?
As a user, the AI model API version should have dynamic parameters like a model.
Currently, https://github.com/Portkey-AI/gateway/blob/27a6ebbc9ddd9…
-
Hey :)
I wanted to ask for an integration of [litellm](https://github.com/BerriAI/litellm) as we use it as a gateway to different ai providers. It would be very cool to trace the litellm requests. …
-
Here's what our usecase doc has:
2. An engineering assistant for Acorn engineers
1. Connect to Notion, Slack, GitHub
2. Answer questions and perform actions (eg. open issues)
That obviou…
-
**Describe the feature you'd like**
I propose that Flowise adds support for configuring custom API endpoints to integrate with different LLM providers, such as Portkey-AI/gateway. This enhancement wo…
-
### The Feature
CF has a free offer for this gateway but there are multiple url for each endpoint and one universal entry point [CF link](https://developers.cloudflare.com/ai-gateway). The idea is to…
-
### What Would You Like to See with the Gateway?
01.ai is a chinese LLM provider with Yi-large being a 34B parameter model with capabilities close to GPT-4. Should like to see 01 as a provider in por…
-
https://github.com/Portkey-AI/gateway/blob/fe0899bbf1a0f65f8f751aca8fca1b0a4409acb4/src/providers/anthropic/chatComplete.ts#L397
OpenAI SDKs with strict response validation (such as https://docs.rs…
-
We should just use the connect server. This will simplify things a lot.
We'll need to migrate the vscode extension to connect to the connect server rather than the gRPC server. Since our connect ser…
-
大佬,问一下哈,Gemini问了问题后回复在当前地区不可用怎么办啊,谢谢
-
In my case, unfortunately with commented these 2 lines deployment has failed.
https://github.com/Azure-Samples/AI-Gateway/blame/ff11430921b54d7452cad820ed6cf1c69318ed8a/labs/built-in-logging/main.…