search

deepset-ai / haystack

:mag: AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
https://haystack.deepset.ai
Apache License 2.0
16.66k stars 1.83k forks source link

Replace gpt-3.5-turbo with gpt-4o-mini model #8222

Open julian-risch opened 4 weeks ago

julian-risch commented 4 weeks ago

As of July 2024, gpt-4o-mini should be used in place of gpt-3.5-turbo: https://platform.openai.com/docs/models/gpt-3-5-turbo It's the default model of OpenAIChatGenerator and OpenAIGenerator. We should treat that change of the default behavior as a breaking change. gpt-3.5-turbo is also used in the code examples of the AnswerJoiner or BranchJoiner.

Here is a list of more mentions in the repo https://github.com/search?q=repo%3Adeepset-ai%2Fhaystack+gpt-3.5-turbo&type=code

julian-risch commented 4 weeks ago

I opened a related issue in haystack-tutorials https://github.com/deepset-ai/haystack-tutorials/issues/341

davidsbatista commented 2 weeks ago

is this tied to a release or can the breaking change warning be generic, i.e.:

"in the upcoming releases gpt-3.5-turbo will be replaced by gpt-4o-mini as de default model"

davidsbatista commented 2 weeks ago

I've added a generic deprecation message not tied to any specific version