search

etkecc / baibot

🤖 A Matrix bot for using diffent capabilities (text-generation, text-to-speech, speech-to-text, image-generation, etc.) of AI / Large Language Models (OpenAI, Anthropic, etc.)
GNU Affero General Public License v3.0
48 stars 4 forks source link

How to connect to Azure hosted OpenAI? #4

Open kitzler-walli opened 2 months ago

kitzler-walli commented 2 months ago

I tried to create a global openai bot with a config like this:

base_url: https://yourname.openai.azure.com/openai/deployments/gpt-4o
api_key: yourkey
text_generation:
  model_id: gpt-4o
  prompt: You are a brief, but helpful bot.
  temperature: 1.0
  max_response_tokens: 16384
  max_context_tokens: 128000

but this only returns Resource not found (code: 404)

When I copy the curl sample from Azure OpenAI Studio this looks like this:

payload="{\"messages\":[{\"role\":\"system\",\"content\":[{\"type\":\"text\",\"text\":\"You are an AI assistant that helps people find information.\"}]}],\"temperature\":0.7,\"top_p\":0.95,\"max_tokens\":800}"
   curl "https://yourname.openai.azure.com/openai/deployments/gpt-4o/chat/completions?api-version=2024-02-15-preview" \
  -H "Content-Type: application/json" \
  -H "api-key: yourkey" \
  -d "$payload"

this works just fine within the container. How will I have to adapt these settings for Baibot?

kitzler-walli commented 1 month ago

When I try to set it up as OpenAI compatible I receive this error: Failed to get response from the OpenAI-compat chat completion API: ApiError("{\"error\":{\"code\":\"404\",\"message\":\"Resource not found\"}}")

TheOneValen commented 1 week ago

I have the same problem in the current version 1.3.2