Edit k8 script - Githubissues

dgarnitz / vectorflow

VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of your choice.

https://www.getvectorflow.com/

Apache License 2.0

676 stars 49 forks source link

Closed dgarnitz closed 1 year ago

dgarnitz commented 1 year ago

Altered the local k8s setup script to fix errors
added in a separate retry queue for the worker so that the main flow is not clogged. NOTE a cron job to add items from the retry queue back to the main queue will be added in a separate PR

Testing succeeds