⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains
- OS: Windows 10 and 11
- Continue: 0.0.38
- IDE: PyCharm
Description
I have added my model configuration in the config.json as follows:
"models": [
{
"title": "Code Llama Local",
"provider": "openai",
"model": "CodeLlama-7b-Instruct-hf",
"apiBase": "http://localhost:18000/v1"
}
],
The model has already been successfully used. However sometimes the model does not show up in the model selection dropdown. Sometimes it is showning the correct model:
Code Llama Local
sometimes it is showing some example models (that I have actually removed from the config):
GPT-4 (Free Trial)
GPT-3.5-Turbo (Free Trial)
and sometimes it is showing no option at all.
I already tried reinstalling the plugin, reinstalling PyCharm and even have used another PC.
The random behaviour remains. Sometimes it is resolved after a restart of the PC, sometimes it works after the restart of PyCharm.
It also seems to be independent of the Model Server running or not.
To reproduce
Unfortunately I did not manage to reproduce the random behaviour reliably.
The setup is described above.
Log output
Only found the following relevant lines in idea.log
2024-03-20 08:40:10,855 [ 247] INFO - #c.i.i.p.PluginManager - Loaded custom plugins: OpenCV Image Viewer (4.0.1), Continue (0.0.38), Copy Git Link (0.5.3)
This happens to me as well. It does seem as though going into Settings > Plugins > continue and disabling/re-enabling will help Continue load the configuration.
Before submitting your bug report
Relevant environment info
Description
I have added my model configuration in the config.json as follows: "models": [ { "title": "Code Llama Local", "provider": "openai", "model": "CodeLlama-7b-Instruct-hf", "apiBase": "http://localhost:18000/v1" } ],
The model has already been successfully used. However sometimes the model does not show up in the model selection dropdown. Sometimes it is showning the correct model:
sometimes it is showing some example models (that I have actually removed from the config):
and sometimes it is showing no option at all.
I already tried reinstalling the plugin, reinstalling PyCharm and even have used another PC. The random behaviour remains. Sometimes it is resolved after a restart of the PC, sometimes it works after the restart of PyCharm. It also seems to be independent of the Model Server running or not.
To reproduce
Unfortunately I did not manage to reproduce the random behaviour reliably. The setup is described above.
Log output