qdrant / vector-db-benchmark

Framework for benchmarking vector search engines
https://qdrant.tech/benchmarks/
Apache License 2.0
270 stars 77 forks source link

Coordinated omission #207

Open gingerwizard opened 1 week ago

gingerwizard commented 1 week ago

Glancing at the code looks like this project makes no effort to measure service and wait time, rather just measuring service time - suffering from Coordinated omission.

I'd suggest authors look at tools such Rally which measure this carefully.

While i dont think qdrant will be impacted as much by this, its more of a concern where systems can stall e.g. JVM based technologies.