search

meain / yaq

Your Assistant for Querying (the web using LLMs)
Apache License 2.0
6 stars 0 forks source link

Allow use of any OpenAI compatible enpoints #28

Closed oatmealm closed 1 month ago

oatmealm commented 1 month ago

As it stands right now I think one is forced to use OpenAI.

meain commented 1 month ago

I wanted to add support for other providers and but I guess just allowing to configure OpenAI base URL is a good start. We would also need to change how we do model selection. As of now, it is a static list, which in itself is not ideal. Ideal would be to fetch it from /models and then use that list to let users pick a model, or maybe it can be just make to a text field.

If you want to give a shot at it, the URL is used here. Fetch from storage happens here and customization page is here.

If you don't wanna take it up, I'll see if I get it sorted out this weekend.

meain commented 1 month ago

The latest version should have support for it. You can either build and load from main or wait for 1.2.0 to land in extension marketplace.

meain commented 1 month ago

It'll look something like this. If you hover on the model label and you have already added API key and url, it will show you a list of labels.

Screenshot 2024-09-20 at 10 46 42 PM
meain commented 1 month ago

Oops, there is a bug in the current implementation. Reopening this.

meain commented 1 month ago

Should be fixed in 1.2.2