Open you-n-g opened 1 year ago
The non-chat completion modes are depredated.
To use the gpt-35-turbo model on Azure, just change the [mode_chat_completion] mode endpoint in the settings.ini file to use your Azure endpoint and add your azure API key. You can also create a new mode entry and change your prompts to use it.
[mode_chat_completion]
endpoint=https://****.openai.azure.com/openai/deployments/gpt-35-turbo/chat/completions?api-version=2023-03-15-preview
model="gpt-3.5-turbo"
api_key=***
max_tokens=3000
temperature=0.2
top_p=1
frequency_penalty=0.0
presence_penalty=0.0
Also works with the gtp-35-turbo-16k model.
[mode_chat_completion_16k]
endpoint=https://****.openai.azure.com/openai/deployments/gpt-35-turbo-16k/chat/completions?api-version=2023-03-15-preview
model="gpt-35-turbo-16k"
api_key=***
max_tokens=3000
temperature=0.2
top_p=1
frequency_penalty=0.0
presence_penalty=0.0
It raises following error in my case
I follow this configuration
[mode_chat_completion]
endpoint=https://****.openai.azure.com/openai/deployments/gpt-35-turbo/chat/completions?api-version=2023-03-15-preview
model="gpt-3.5-turbo"
api_key=***
max_tokens=3000
temperature=0.2
top_p=1
frequency_penalty=0.0
presence_penalty=0.0
Thanks!