search

symbiont-me / symbiont-backend

Symbiont.me backend in python
GNU General Public License v3.0
2 stars 1 forks source link

Add kit to allow running local LLMs and Vector models #54

Open thelonehegelian opened 5 months ago

thelonehegelian commented 5 months ago

In line with the main philosophy of the Symbiont app, we want to use products that are open source and provide the option for self-hosting for maximum privacy and control.

thelonehegelian commented 5 months ago

A CLI based script that can pull a model from huggingface and deploy locally, serving as a local LLM or Embeddings model. For best privacy

thelonehegelian commented 5 months ago

we can modify this: https://gist.github.com/AmgadHasan/2d80064928face09d7a8ffadaca6caf1