Support Azure serverless deployment for Cohere model

lofcz / LlmTornado

One .NET library to consume OpenAI, Anthropic, Cohere, Google, Azure, Groq, and self-hosed APIs.

https://github.com/lofcz/LlmTornado

MIT License

31 stars 11 forks source link

Support Azure serverless deployment for Cohere model #21

Open sgjsakura opened 2 months ago

sgjsakura commented 2 months ago

Currently Azure AI Hub (ai.azure.com) supports serverless Cohere model on Azure cloud service, the endpoint for these deployments are similar with OpenAI Azure Service. This package does not support use custom API endpoint URL cohere. Please kindly give support for this situation and many thanks.

lofcz commented 1 month ago

Support for Azure Cohere will be added in version 3.1