search

qdrant / vector-db-benchmark

Framework for benchmarking vector search engines
https://qdrant.tech/benchmarks/
Apache License 2.0
250 stars 68 forks source link

fix: Temporarily disable dbpedia openai BQ benchmarking #149

Closed KShivendu closed 1 month ago

KShivendu commented 1 month ago 
numpy.core._exceptions._ArrayMemoryError: Unable to allocate 5.58 GiB for an array with shape (1497600000,) and data type float32
Traceback (most recent call last):

  File "/code/run.py", line 91, in <module>
    app()

  File "/code/run.py", line 86, in run
    raise e

  File "/code/run.py", line 59, in run
    client.run_experiment(

  File "/code/engine/base_client/client.py", line 108, in run_experiment
    upload_stats = self.uploader.upload(

  File "/code/engine/base_client/upload.py", line 56, in upload
    latencies = list(

  File "/usr/local/lib/python3.10/multiprocessing/pool.py", line 873, in next
    raise value

numpy.core._exceptions._ArrayMemoryError: Unable to allocate 5.58 GiB for an array with shape (1497600000,) and data type float32
KShivendu commented 1 month ago

Not required because I created a smaller (100K) dataset.