ItzCrazyKns / Perplexica

Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI
MIT License
13.67k stars 1.3k forks source link

Support for Upstage LLM and Embeddings #218

Open JuHyung-Son opened 3 months ago

JuHyung-Son commented 3 months ago

Is your feature request related to a problem? Please describe. Feature request about adding llm and embedding provider Solar. It is number one llm provider in APAC. Can be used by their API or aws jumpstart.

Solar shows very nice performance in Korean and Japanese. And Thai is coming soon.

If you agree, I'll work on it and give you a PR.

Additional context See more about Solar.

https://www.predibase.com/blog/solar-llm-on-predibase-the-best-llm-for-fine-tuning?utm_medium=partner&utm_source=upstage https://www.linkedin.com/posts/leohp_openai-activity-7205473539208998912-w8-W/

ItzCrazyKns commented 2 months ago

Hi @JuHyung-Son, we've restructured how providers are created in Perplexica, you can now add (and maintain) the Solar provider. Here are the steps to add it:

  1. First add the provider in the src/lib/providers folder, you can see how other providers are implemented and follow the same format to add the Solar provider.
  2. Once that is done, you can add the provider into the providers list in the src/lib/providers/index.ts file.
  3. After that, you need to add an input in the settings menu for the API key and pass it with the config, for more details see ui/components/SettingsDialog.tsx, src/config.ts, src/routes/config.ts.