No option for openai compatible endpoint

[shinebarbhuiya]

Before submitting your bug report

• [X] I believe this is a bug. I'll try to join the Continue Discord for questions
• [X] I'm not able to find an open issue that reports the same bug
• [X] I've seen the troubleshooting guide on the Continue Docs

Relevant environment info

- OS:
- Continue:
- IDE:
- Model:
- config.json:

Description

Super irritating!

To reproduce

No response

Log output

No response

[sestinj]

Hi @shinebarbhuiya, thanks for sharing—we definitely intend for it to be possible to use OpenAI-compatible APIs, but perhaps our mistake here is that it's not easy enough to discover.

Here are details on how to use any OpenAI-compatible API: https://docs.continue.dev/customize/model-providers/openai#openai-compatible-servers--apis

I'd be curious to understand at what point in onboarding you felt this was missing

[callbacked]

@sestinj It used to be an easily accessible option prior to the current update. Unless you added your OpenAI compatible API before the new update, you must add it through config.json now which is less than ideal and compromises on the UX flow a bit. It would be nice to have both options to add it like before.

before

now (While the screenshot only shows a portion of the drop-down options, there is no option for using an OpenAI compatible API when scrolling through the options)

[sestinj]

I see! This is a good point