feat/enh: Possibility to add self signed TLS Certs for the Ollama API

[jannikstdl]

Validations

• [X] I believe this is a way to improve. I'll try to join the Continue Discord for questions
• [X] I'm not able to find an open issue that requests the same enhancement

Problem

Hello,

we would like to assign the Ollama Base API to a self signed HTTPS Address. (Because we want a encrypted communication between Continue and Ollama in our organisation) Something like https://ai.example.test wich refers to the Ollama base Endpoint.

But after setting this route we get a cert error in VSCode (unable to verify first certificate):

In the Developer Console:

We can access the URL on the same server in the browser without getting any error. Thank you!

Solution

No response

[jannikstdl]

@sestinj and co any updates on that?

Has PR #1658 something to do with that?

verifySsl set to false in the requestOptions like that:

"models": [
    {
      "title": "FastChat",
      "provider": "openai",
      "model": "Mistral-7B-Instruct-v0.2",
      "apiKey": "EMPTY",
      "apiBase": "https://openaiserver-private.local/v1",
      "requestOptions": {
        "verifySsl": false,
      }
    }
  ],

did not change anything.

There are multiple related Issues #889 #1474