search

continuedev / continue

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains
https://docs.continue.dev/
Apache License 2.0
19.25k stars 1.66k forks source link

remote ollama server #2895

Closed szkane closed 2 days ago

szkane commented 3 days ago

Validations

Problem

The current version only supports local ollama, and the ollama server with the specified URL cannot be configured.

Solution

Provide a configuration that can be used to set up the Ollama server and customize the prompt.

StefanB7 commented 3 days ago

You can specify a remote server with the apiBase property, like so:

    {
      "title": "Qwen Coder 2.5 14B",
      "model": "qwen2.5-coder:14b",
      "provider": "ollama",
      "apiBase": "http://192.168.1.1:11434"
    }
szkane commented 2 days ago

You can specify a remote server with the apiBase property, like so:

    {
      "title": "Qwen Coder 2.5 14B",
      "model": "qwen2.5-coder:14b",
      "provider": "ollama",
      "apiBase": "http://192.168.1.1:11434"
    }

@StefanB7 Thanks, awesome!