qdrant / vector-db-benchmark

Framework for benchmarking vector search engines
https://qdrant.tech/benchmarks/
Apache License 2.0
270 stars 77 forks source link

Add benchmark on collection load time #204

Closed tellet-q closed 1 week ago

tellet-q commented 1 week ago

Prepare snapshots for cases, upload them to GCP&authuser=0&project=key-surf-337615):

tellet-q commented 1 week ago

Example run: https://github.com/qdrant/vector-db-benchmark/actions/runs/11035515022

tellet-q commented 1 week ago

@KShivendu @generall I wanted to run the runLoadTimeBenchmark job in parallel, almost everything is ready in code for that, but it not possible since the 2nd server has ARM architecture and we don't have Docker images for ARM.

tellet-q commented 1 week ago

I updated the code to run the benchmark in parallel with tenants benchmark. The benchmark runs in a separate server machine and only the client machine is shared.

https://github.com/qdrant/vector-db-benchmark/actions/runs/11051637232