qdrant / vector-db-benchmark

Framework for benchmarking vector search engines
https://qdrant.tech/benchmarks/
Apache License 2.0
268 stars 76 forks source link

Breaking change in `weaviate-client` #199

Open LukasWestholt opened 1 week ago

LukasWestholt commented 1 week ago

The dependency weaviate-client got an (for us) breaking change:

A refactoring of the underlying implementation of the WeaviateClient to use the WeaviateAsyncClient under-the-hood scheduling the necessary coroutines to run in a side-car event-loop thread

(see https://weaviate-python-client.readthedocs.io/en/stable/changelog.html#version-4-7-0)

The event-loop thread (Singleton) in WeaviateClient prevents parallel upload > 1 from working. Because only one instance of the .connect() class is allowed at any one time.

See https://github.com/weaviate/weaviate-python-client/pull/1007

So for a hotfix i will prepare a new version constraint for weaviate-client.

LukasWestholt commented 1 week ago

After merging, we have to think about migrating WeaviateClient to WeaviateAsyncClient, right? @trengrj