benchmark test values 0

zilliztech / VectorDBBench

A Benchmark Tool for VectorDB

MIT License

522 stars 133 forks source link

benchmark test values 0 #284

Closed dipshirajput closed 5 months ago

dipshirajput commented 7 months ago

Hi all, while i was trying to run the test to have a comparison benchmark between Milvus and Qdrant, i am getting all values as 0,

please let me know for some suggestions. Thanks in advance. mil

alwayslove2013 commented 7 months ago

Regarding the error with qdrant, it appears to be a configuration error in the parameters. Could you please check if you are testing QdrantCloud or locally deployed?
As for milvus, there is no information related to milvus in the logs here. Could you please rerun it, for example, rerun the case of 768dim1M, and provide us with the log information?

dipshirajput commented 7 months ago

Hi @alwayslove2013 , its Milvus versus QuadrantCloud . and i have just used this, https://github.com/zilliztech/VectorDBBench link in order to perform the comparison. do we need to execute anything extra than that ?

alwayslove2013 commented 7 months ago

@dipshirajput

We are trying to solve the QdrantCloud Client issue.
Regarding the Milvus error, we need more complete logs, we can't see any milvus error in the screenshot.

dipshirajput commented 6 months ago

Hi @alwayslove2013 , which step is responsible for running the databases ? i mean if i run init_bench , its unable to connect to the milvus server.

Screenshot from 2024-03-14 13-01-18

Please let me know for any suggestions. Thanks.

alwayslove2013 commented 6 months ago

@dipshirajput You are testing Laion 100M data, there are some problems with this case. The latest 0.0.7 has fixed it, you need to upgrade it first.

Or now you can test Milvus with the Cohere 768dim 1M case, a smaller dataset.

dipshirajput commented 6 months ago

@alwayslove2013 with Cohere 768dim 1M, i am still getting the same. Screenshot from 2024-03-14 13-48-41

alwayslove2013 commented 6 months ago

@dipshirajput Cloud you please confirm that you have successfully deployed the milvus service? VDBBench is just a test client.

FYI, https://milvus.io/docs/install_standalone-helm.md