dgarnitz / vectorflow

VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of your choice.
https://www.getvectorflow.com/
Apache License 2.0
670 stars 47 forks source link

Add pip package and install script #65

Closed dgarnitz closed 1 year ago

dgarnitz commented 1 year ago

What

Add scripts to support the creation of a pip package and two command install of VectorFlow to better improve DevEx. This will NOT install Docker or docker-compose

Also refactored the client scripts for embedding data and uploading it into vector DBs into a clients directory.

Verification

The setup.sh script successfully pulls all the needed images, builds the VectorFlow docker images and runs them using docker compose. This also works with pip install vectorflow-ai and the vectorflow command.

image

As you can see, requests to embed succeed:

image