search

SciPhi-AI / R2R

production-ready RAG engine with a sh*t ton of features.
https://r2r-docs.sciphi.ai/
MIT License
2.31k stars 153 forks source link

Support for Solar LLM and embedding #542

Open JuHyung-Son opened 6 days ago

JuHyung-Son commented 6 days ago

Feature request about adding llm and embedding provider Solar. It is number one llm provider in APAC. Can be used by their API or aws jumpstart.

Solar shows very nice performance in Korean and Japanese. And Thai is coming soon.

If you agree, I'll work on it and give you a PR.

Additional context See more about Solar.

https://www.predibase.com/blog/solar-llm-on-predibase-the-best-llm-for-fine-tuning?utm_medium=partner&utm_source=upstage https://www.linkedin.com/posts/leohp_openai-activity-7205473539208998912-w8-W/

emrgnt-cmplxty commented 5 days ago

Thanks JuHyung,

We will read up and get back to you. Is solar open sourcing their models or would this be through the API only?

JuHyung-Son commented 5 days ago

It works through API only.

and I can work on it. I added Solar on langchain and llama-index too.

emrgnt-cmplxty commented 5 days ago

We are trying to keep the number of integrations in this repository to a minimum. What dependencies would this introduce?

JuHyung-Son commented 5 days ago

just requests or openai