search

rashadphz / farfalle

🔍 AI search engine - self-host with local or cloud LLMs
https://www.farfalle.dev/
Apache License 2.0
2.76k stars 245 forks source link

Feature Request: Support for SambaNova, Google Models + Cloud Version Down #95

Open mugenyume opened 2 months ago

mugenyume commented 2 months ago

Hi @rashadphz,

I’d like to suggest adding support for the SambaNova API and their models. Since SambaNova is OpenAI compatible, it can be accessed through LiteLLM. I gave it a shot, but I ran into this error:

500: 'Message' object has no attribute 'tool_calls'

Not sure what's causing this, but it would be awesome if SambaNova models could be used just like OpenAI and Groq models in the project.

Also, can we get support for the Google API and Gemini models? They’re accessible through LiteLLM as well, but you’ll need to install the google-generativeai pip package first.

By the way, thanks for setting up the cloud version at farfalle.dev! However, it seems to be down at the moment. Could you check on that when you get a chance?

Appreciate all the work you’ve put in! <3

mugenyume commented 1 month ago

Also, it would be nice to add support for OpenRouter models