search

Mintplex-Labs / anything-llm

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more.
https://anythingllm.com
MIT License
22.86k stars 2.32k forks source link

[FEAT]: OpenRouter - Fetch from API #1173

Closed timothycarambat closed 5 months ago

timothycarambat commented 5 months ago

What would you like to see?

For OpenRouter we use a statically bundled JSON object to report the models because the JSON is quite large. Given how OpenRouter integrates models very quickly it does not make sense to have this be a chore we have to do every week.

https://openrouter.ai/docs#models

They have a /models endpoint we should leverage.

joebitcoinorg commented 6 days ago

How can I edit the config file to make a selection for an Openrouter llm selection?

I want to select the new OpenAI o1 versions. But even with my openrouter api key entered, the dropdown selector won't populate. Hmmm... maybe since it's so large - I might need to let it sit there for several minutes.