We should add the gpt-4o and gpt-4o-mini models to the dropdowns in the Settings panel, and remove the 3.5 model as an option, as gpt-4o-mini offers better Cypher generation performance. In my experience, gpt-3.5-turbo generates rather poor Cypher queries, as it frequently generates queries with the wrong relationship direction (poor reasoning ability when it comes to understanding the provided graph schema). So I suggest that we remove the 3.5 model from the dropdown list (also, see the deprecation reminder below).
We should keep gpt-4 as it's still a high quality model and generates decent Cypher.
In summary, we should provide the following list of models to balance cost-effectiveness and quality:
gpt-4
gpt-4o
gpt-4o-mini
No changes to the prompts are necessary, as the new 4o models seem to have better reasoning ability than the earlier versions prior to 4, at least for the purpose of Cypher generation, which is all we care about here.
Deprecation reminder
OpenAI is deprecating some of the 3.5-turbo models on 13 September:
We should add the
gpt-4oandgpt-4o-minimodels to the dropdowns in the Settings panel, and remove the 3.5 model as an option, asgpt-4o-minioffers better Cypher generation performance. In my experience,gpt-3.5-turbogenerates rather poor Cypher queries, as it frequently generates queries with the wrong relationship direction (poor reasoning ability when it comes to understanding the provided graph schema). So I suggest that we remove the 3.5 model from the dropdown list (also, see the deprecation reminder below).We should keep
gpt-4as it's still a high quality model and generates decent Cypher.In summary, we should provide the following list of models to balance cost-effectiveness and quality:
gpt-4gpt-4ogpt-4o-miniNo changes to the prompts are necessary, as the new
4omodels seem to have better reasoning ability than the earlier versions prior to 4, at least for the purpose of Cypher generation, which is all we care about here.Deprecation reminder
OpenAI is deprecating some of the 3.5-turbo models on 13 September:
More information on the deprecations page: https://platform.openai.com/docs/deprecations