deepset-ai / haystack

AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
https://haystack.deepset.ai
Apache License 2.0
17.72k stars 1.92k forks source link

Replace gpt-3.5-turbo with gpt-4o-mini model #8222

Closed julian-risch closed 2 months ago

julian-risch commented 3 months ago

As of July 2024, gpt-4o-mini should be used in place of gpt-3.5-turbo: https://platform.openai.com/docs/models/gpt-3-5-turbo It's the default model of OpenAIChatGenerator and OpenAIGenerator. We should treat that change of the default behavior as a breaking change. gpt-3.5-turbo is also used in the code examples of the AnswerJoiner or BranchJoiner.

Here is a list of more mentions in the repo https://github.com/search?q=repo%3Adeepset-ai%2Fhaystack+gpt-3.5-turbo&type=code

julian-risch commented 3 months ago

I opened a related issue in haystack-tutorials https://github.com/deepset-ai/haystack-tutorials/issues/341

davidsbatista commented 2 months ago

is this tied to a release or can the breaking change warning be generic, i.e.:

"in the upcoming releases gpt-3.5-turbo will be replaced by gpt-4o-mini as de default model"

davidsbatista commented 2 months ago

I've added a generic deprecation message not tied to any specific version