Unable to work with the Cohere Virtual Key Setup

Portkey-AI / gateway

A Blazing Fast AI Gateway. Route to 200+ LLMs with 1 fast & friendly API.

https://portkey.ai/features/ai-gateway

MIT License

5.38k stars 364 forks source link

Unable to work with the Cohere Virtual Key Setup #151

Open ranjancse26 opened 6 months ago

ranjancse26 commented 6 months ago

I happened to set up the Cohere Virtual Key on the Portkey gateway UI. However, upon creating the prompt and selecting the Cohere provider, I am unable to select any model. Getting error - "No Foundation Model found matching selected Mode"

VisargD commented 6 months ago

Thanks for reporting the issue. Cohere was not actively supported as a part of prompt management. We will add cohere models to prompt management in a day. I will update this thread once it is available.

ranjancse26 commented 6 months ago

@VisargD Any updates on this. It's a major roadblock for the evaulation.

VisargD commented 6 months ago

Apologies for the delay here. We are still working on this. This should be live in first half of next week. This needs a deeper mapping as cohere supports a lot of extra params like connectors, search_queries_only, citations, etc in their new /chat route.