search

XInTheDark / raycast-g4f

Raycast extension to use GPT-4, Llama-3, and more... all for FREE. No API Key required!
GNU General Public License v3.0
403 stars 36 forks source link

Support for custom OpenAI compatible endpoints #107

Closed slockers37 closed 1 month ago

slockers37 commented 2 months ago

I would like it if I could add a custom endpoint of my own like groq or openrouter or something else thats OpenAI comptabile. Allow specifying the endpoint url and an API key and fetch the models available from the endpoint /models and give a dropdown that allows the user to select the model

PS: Love this project btw.

XInTheDark commented 2 months ago

Thanks for your support! Sure, I can add it. Expect it in a future release!

XInTheDark commented 1 month ago

Hi! The feature has been mostly completed, and you can expect it in the next update. By the way, I don't think having a /models endpoint is mandatory for OpenAI-compatible APIs; and also https://api.openai.com/v1/models and https://api.together.xyz/v1/models, etc... require an API Key to access which is probably too inconvenient to be included as a feature

XInTheDark commented 1 month ago

Hey, I've added it in v3.7, looking forward to your thoughts on it! :)