continuedev / continue

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains
https://docs.continue.dev/
Apache License 2.0
18.67k stars 1.57k forks source link

Ollama models use json output format #2727

Open kohlerm opened 1 day ago

kohlerm commented 1 day ago

Before submitting your bug report

Relevant environment info

- OS: macOS
- Continue version: dev branch
- IDE version: 1.95 insider
- Model: all ollama models
- config.json:

Description

https://github.com/continuedev/continue/blob/694a044a608e0700cab027dec9ad580f111a234a/core/llm/llms/Ollama.ts#L248 forces the model to output json

To reproduce

No response

Log output

No response

kohlerm commented 1 day ago

removing the line fixes it

florian-hansen-mw commented 10 hours ago

My ollama models recently stopped working and my tabAutoCompletion only suggests "{" anymore. I think this might be the cause. This renders the autocompletion unusable.

Just confirmed. I have the same config.json file for IntelliJ and VS Code.

In VSCode, I get meaningful autocomplete suggestions. In IntelliJ, I just see "{".

I am on the latest Continue@IntelliJ 0.0.79 running on IntelliJ Ultimate 2024.2.4