add deepinfra provider

[morandalex]

Validations

• [x] I believe this is a way to improve. I'll try to join the Continue Discord for questions
• [x] I'm not able to find an open issue that requests the same enhancement

Problem

I cannot add deep infra provider. seems not working

  "models": [
    {
      "title": "deepinfra-mixtralai",
      "provider": "openai",
      "model": "mistralai/Mixtral-8x7B-Instruct-v0.1",
      "apiKey": "<apikey>",
      "apiBase": "https://api.deepinfra.com/v1/openai"
    },
]

ollama works, so I would say is a problem coming from continue.dev

Solution

No response

[sestinj]

As per docs here they only support this OpenAI API for a few models, mixtral not included. So you're right, we'll have to add a new provider. Will do this soon and let you know when the update is ready

[sestinj]

Added in this commit and will be available in ~20min in pre-release version 0.9.1

[morandalex]

awesome guys!