Added milvus support - Githubissues

dgarnitz / vectorflow

VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of your choice.

https://www.getvectorflow.com/

Apache License 2.0

670 stars 47 forks source link

Added milvus support #29

Closed dgarnitz closed 1 year ago

dgarnitz commented 1 year ago

What

Added support for Miluvs. This has a hardcoded schema of

fields = [
     FieldSchema(name="id", dtype=DataType.VARCHAR, is_primary=True, auto_id=False, max_length=128),
     FieldSchema(name="source_text", dtype=DataType.VARCHAR, max_length=2048),
     FieldSchema(name="embeddings", dtype=DataType.FLOAT_VECTOR, dim=1536)
]

Which is the same as the other vector DBs.

Verification

Request to process milvus data succeeds:

Upload succeeds