config for Azure OpenAI

[borisdev]

Objective

Handle Azure OpenAI configs

Motivation

shai list all files
? Select a command:
❯ ls
  Generate new suggestions
  Dismiss

Result latency

• 4 seconds for Azure hosted OpenAI
• 8 seconds for OpenAI

Example Azure OpenAI config

{
  "OPENAI_API_TYPE": "azure",
  "OPENAI_API_KEY": "d19084f8878843218b77d101a76b5b42",
  "OPENAI_API_VERSION": "2023-05-15",
  "OPENAI_MODEL": "gpt-3.5-turbo",
  "SHAI_SUGGESTION_COUNT": "3",
  "AZURE_DEPLOYMENT_NAME": "test-whychain",
  "AZURE_API_BASE": "https://whychaintest.openai.azure.com/",
  "SHAI_SUGGESTION_COUNT": "3"
}

Twitter handle: @boris_dev

[ricklamers]

This looks good! Although I think we can also use the n param https://api.python.langchain.com/en/latest/chat_models/langchain.chat_models.azure_openai.AzureChatOpenAI.html

Could you make that change?

[borisdev]

This looks good! Although I think we can also use the n param https://api.python.langchain.com/en/latest/chat_models/langchain.chat_models.azure_openai.AzureChatOpenAI.html

Could you make that change?

Done!

[ricklamers]

Fantastic!