search

Portkey-AI / gateway

A Blazing Fast AI Gateway. Route to 200+ LLMs with 1 fast & friendly API.
https://portkey.ai/features/ai-gateway
MIT License
5.21k stars 356 forks source link

[Feature] Configuring chatglm with portkey-ati Gateway in Autogen Studio: Local Provider Setup #396

Closed poweryu closed 6 days ago

poweryu commented 4 weeks ago

What Would You Like to See with the Gateway?

I want to use chatglm in autogen studio through portkey-ati's gateway, but autogen studio cannot configure createHeaders. Can I set the provider in the local configuration of the gateway?

Context for your Request

No response

Your Twitter/LinkedIn

No response

vrushankportkey commented 6 days ago

Hi @poweryu Portkey has native support for ChatGLM models. Here's the doc for it - https://portkey.ai/docs/welcome/integration-guides/zhipu

You can route to any LLM in your Autogen app, including the ChaGLM - using Portkey. Here's more on that - https://portkey.ai/docs/welcome/integration-guides/autogen#using-100-models-in-autogen-through-portkey

Let me know if this helps! Will close the issue for now, please feel free to reopen it if needed