continuedev / continue

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains
https://docs.continue.dev/
Apache License 2.0
13.89k stars 991 forks source link

Model sometimes does not show up in selection dropdown #998

Open julien-seitz opened 4 months ago

julien-seitz commented 4 months ago

Before submitting your bug report

Relevant environment info

- OS: Windows 10 and 11
- Continue: 0.0.38
- IDE: PyCharm

Description

I have added my model configuration in the config.json as follows: "models": [ { "title": "Code Llama Local", "provider": "openai", "model": "CodeLlama-7b-Instruct-hf", "apiBase": "http://localhost:18000/v1" } ],

The model has already been successfully used. However sometimes the model does not show up in the model selection dropdown. Sometimes it is showning the correct model:

sometimes it is showing some example models (that I have actually removed from the config):

and sometimes it is showing no option at all.

I already tried reinstalling the plugin, reinstalling PyCharm and even have used another PC. The random behaviour remains. Sometimes it is resolved after a restart of the PC, sometimes it works after the restart of PyCharm. It also seems to be independent of the Model Server running or not.

To reproduce

Unfortunately I did not manage to reproduce the random behaviour reliably. The setup is described above.

Log output

Only found the following relevant lines in idea.log

2024-03-20 08:40:10,855 [    247]   INFO - #c.i.i.p.PluginManager - Loaded custom plugins: OpenCV Image Viewer (4.0.1), Continue (0.0.38), Copy Git Link (0.5.3)
bastienjalbert commented 4 months ago

Same issue here (pycharm + macos)

tmibkr commented 4 months ago

This happens to me as well. It does seem as though going into Settings > Plugins > continue and disabling/re-enabling will help Continue load the configuration.