search

pathwaycom / llm-app

Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.
https://pathway.com/developers/templates/
MIT License
4.68k stars 236 forks source link

Question: local HF model + Auto update index from specific folder #74

Closed Maxamed closed 9 months ago

Maxamed commented 11 months ago

Steps to reproduce

Which option to use if the usecase is :

  1. Using local HF model
  2. Auto update index from specific folder
  3. Store embeddings in database

Love this project !

Relevant log output

Not available

What did you expect to happen?

Easier way to deploy and use

Version

1

Docker Versions (if used)

No response

OS

MacOS

On which CPU architecture did you run Pathway?

ARM64 (AArch64, Apple silicon)

dxtrous commented 10 months ago

You can use the "contextful" example as a template (or "alerting", or "unstructured" depending on your need).

Then, replace any references in the code to OpenAI with those to HuggingFace - as in the "local" example.