search

bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
https://petals.dev
MIT License
8.89k stars 489 forks source link

support quivr or privateGPT? #524

Open lbgws2 opened 9 months ago

lbgws2 commented 9 months ago

Using Quivr or PrivateGPT allows you to ask questions about documents, and they integrate a series of tools to better utilize the knowledge base

Is it possible for pets to work with them??

uultimaa7 commented 8 months ago

Maybe it already works to use embedding models and vector databases, and we just need to figure it out.

borzunov commented 8 months ago

Hi @lbgws2 @uultimaa7,

Please take a look at methods available in Langchain. We're also working on an example involving using Petals with a knowledge base.