search

pathwaycom / llm-app

Dynamic RAG for enterprise. Ready to run with Docker,⚡in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.
https://pathway.com/developers/templates/
MIT License
3.36k stars 192 forks source link

Question: local HF model + Auto update index from specific folder #74

Closed Maxamed closed 4 months ago

Maxamed commented 6 months ago

Steps to reproduce

Which option to use if the usecase is :

  1. Using local HF model
  2. Auto update index from specific folder
  3. Store embeddings in database

Love this project !

Relevant log output

Not available

What did you expect to happen?

Easier way to deploy and use

Version

1

Docker Versions (if used)

No response

OS

MacOS

On which CPU architecture did you run Pathway?

ARM64 (AArch64, Apple silicon)

dxtrous commented 5 months ago

You can use the "contextful" example as a template (or "alerting", or "unstructured" depending on your need).

Then, replace any references in the code to OpenAI with those to HuggingFace - as in the "local" example.