Feature Request: Is it possible to support Microsoft Azure GPT endpoint>

[wang2nd]

The python SDK support it so I assume not only the kernel, model, but also the interfaces are same.

[cryptoapebot]

Should be supported in 0.12.0. Just use the other constructor.

https://github.com/TheoKanning/openai-java/blob/93a556eb4fb68133c0920c69612a9d7ced0b15cb/client/src/main/java/com/theokanning/openai/OpenAiService.java

[wang2nd]

Thanks!

[wang2nd]

Should be supported in 0.12.0. Just use the other constructor.

https://github.com/TheoKanning/openai-java/blob/93a556eb4fb68133c0920c69612a9d7ced0b15cb/client/src/main/java/com/theokanning/openai/OpenAiService.java

I figured it out, the OpenAIService class you referenced here is a deprecated version, and as its comment "/**

• Use the OpenAiService from the new 'service' library. See README for more details. */ @Deprecated"

I will switch to the Client library or just customize service library version through the OpenAIApi constructor as showed in readme. to see whether it works, but at the same time, please update the service library accordingly, below is a screenshot to prove service library is out of date

I m using the OpenAIService.java in the Service library and its source codes clearly still the old version,

Thanks,

[wang2nd]

I can change the base url by customizing, but don't think it will work without other changes for Azure, due to its actual deployment path

e.g. https://myorganization-openai-test-1.openai.azure.com/openai/deployments/myorganizationDeployement/chat/completions?api-version=2023-03-15-preview

here is the python version to support it

import os
import openai
openai.api_type = "azure"
openai.api_base = "https://myorganization-openai-test-1.openai.azure.com/"
openai.api_version = "2023-03-15-preview"
openai.api_key = os.getenv("OPENAI_API_KEY")

response = openai.ChatCompletion.create(
  engine="myorganizationDeployement",
  messages = [],
  temperature=0.7,
  max_tokens=800,
  top_p=0.95,
  frequency_penalty=0,
  presence_penalty=0,
 stop=None)

[cryptoapebot]

Yeah, prob need to create a new service constructor w/ a flag as the paths are diff enough.