Update GPT35 turbo to 1103

Azure-Samples / azure-search-openai-demo

A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.

https://azure.microsoft.com/products/search

MIT License

5.61k stars 3.76k forks source link

Update GPT35 turbo to 1103 #1185

Open tonybaloney opened 5 months ago

tonybaloney commented 5 months ago

We need to consider updating the GPT35 turbo model for this repo:

Version 0613 of gpt-35-turbo and gpt-35-turbo-16k will be retired on June 13, 2024.

1103 is not available in all the regions that 0603 was, but it has some new ones https://learn.microsoft.com/en-au/azure/ai-services/openai/concepts/models#gpt-35-turbo-model-availability

ShantanuNair commented 5 months ago

This is sad, goodbye longform outputs.

OpenAI deprecating the only model supporting >4096 token generation capability
Anthropic has done the same with all Claude models
Azure is deprecating the >4096 models same as OpenAI is

@pamelafox Any suggestions on what people could use as a suitable replacement, especially concerning longform output? I understand if you cannot disclose certain details, but it seems like there isn't going to be any model release that's going to serve this use.