microsoft / semantic-kernel-java

Semantic Kernel for Java. Integrate cutting-edge LLM technology quickly and easily into your Java based apps. See https://aka.ms/semantic-kernel.
MIT License
97 stars 18 forks source link

Bug: Issue with API Version Compatibility When Using AzureOpenAI #244

Open TmmmmmR opened 1 month ago

TmmmmmR commented 1 month ago

Describe the bug I am currently working with the Azure GPT-35-Turbo and encountered an issue while trying to implement an example from the Microsoft Semantic Kernel Java SDK. Specifically, I was following the example provided here

To Reproduce Upon execution, I received the following error messages indicating a problem related to the API version compatibility:

14:56:37 WARN  c.m.s.s.KernelFunctionFromPrompt - Something went wrong while rendering the semantic function or while executing the text completion. Function: null.genapi. Error: Status code 400, "response_format value as json_schema is enabled only for api versions 2024-08-01-preview and later"
Exception in thread "main" com.azure.core.exception.HttpResponseException: Status code 400, "response_format value as json_schema is enabled only for api versions 2024-08-01-preview and later"

It appears that the response_formatvalue json_schemais only enabled for API versions "2024-08-01-preview" and later. The error logs suggest that the current API version I am using does not support this feature.

Expected behavior An additional parameter to specify the API version to use by the client.

johnoliver commented 1 month ago

The model/api version is defined in the Azure Open AI portal, see: working-with-models