Failing Search Performance Test (100M Dataset, 768 Dim)

[kish5430]

HI Team,

Search Performance Test (100M Dataset, 768 Dim) is failing with below error. Could you plz fix the issue asap.

Error: 2024-03-01 04:29:23,424 | INFO: local dataset root path not exist, creating it: /tmp/vectordb_bench/dataset/laion/laion_large_100m (data_source.py:126) (55) 2024-03-01 04:29:23,425 | INFO: Start to downloading files, total count: 104 (data_source.py:142) (55) 2%|▏ | 2/104 [00:02<01:42, 1.01s/it] 2024-03-01 04:29:25,444 | WARNING: pre run case error: The specified key does not exist. (task_runner.py:92) (55) 2024-03-01 04:29:25,444 | WARNING: [1/1] case {'label': <CaseLabel.Performance: 2>, 'dataset': {'data': {'name': 'LAION', 'size': 100000000, 'dim': 768, 'metric_type': <MetricType.L2: 'L2'>}}, 'db': 'Milvus-100M_HNSW'} failed to run, reason=The specified key does not exist. (interface.py:187) (55) Traceback (most recent call last): File "/app/VectorDBBench/lib64/python3.11/site-packages/vectordb_bench/interface.py", line 168, in _async_task_v2 case_res.metrics = runner.run(drop_old) ^^^^^^^^^^^^^^^^^^^^ File "/app/VectorDBBench/lib64/python3.11/site-packages/vectordb_bench/backend/task_runner.py", line 96, in run self._pre_run(drop_old) File "/app/VectorDBBench/lib64/python3.11/site-packages/vectordb_bench/backend/task_runner.py", line 93, in _pre_run raise e from None File "/app/VectorDBBench/lib64/python3.11/site-packages/vectordb_bench/backend/task_runner.py", line 87, in _pre_run self.ca.dataset.prepare(self.dataset_source) File "/app/VectorDBBench/lib64/python3.11/site-packages/vectordb_bench/backend/dataset.py", line 202, in prepare source.reader().read( File "/app/VectorDBBench/lib64/python3.11/site-packages/vectordb_bench/backend/data_source.py", line 145, in read self.fs.download(s3_file, local_ds_root.as_posix()) File "/app/VectorDBBench/lib64/python3.11/site-packages/fsspec/spec.py", line 1534, in download return self.get(rpath, lpath, recursive=recursive, *kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/VectorDBBench/lib64/python3.11/site-packages/fsspec/asyn.py", line 118, in wrapper return sync(self.loop, func, args, *kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/VectorDBBench/lib64/python3.11/site-packages/fsspec/asyn.py", line 103, in sync raise return_result File "/app/VectorDBBench/lib64/python3.11/site-packages/fsspec/asyn.py", line 56, in _runner result[0] = await coro ^^^^^^^^^^ File "/app/VectorDBBench/lib64/python3.11/site-packages/fsspec/asyn.py", line 650, in _get return await _run_coros_in_chunks( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/VectorDBBench/lib64/python3.11/site-packages/fsspec/asyn.py", line 254, in _run_coros_in_chunks await asyncio.gather(chunk, return_exceptions=return_exceptions), ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib64/python3.11/asyncio/tasks.py", line 442, in wait_for return await fut ^^^^^^^^^ File "/app/VectorDBBench/lib64/python3.11/site-packages/s3fs/core.py", line 1224, in _get_file body, content_length = await _open_file(range=0) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/VectorDBBench/lib64/python3.11/site-packages/s3fs/core.py", line 1215, in _open_file resp = await self._call_s3( ^^^^^^^^^^^^^^^^^^^^ File "/app/VectorDBBench/lib64/python3.11/site-packages/s3fs/core.py", line 348, in _call_s3 return await _error_wrapper( ^^^^^^^^^^^^^^^^^^^^^ File "/app/VectorDBBench/lib64/python3.11/site-packages/s3fs/core.py", line 140, in _error_wrapper raise err

Thanks

[XuanYang-cn]

same as: #275

[XuanYang-cn]

should be fixed by #287 The fixes will be released at 0.0.7 milestone

[anrahman4]

When will 0.0.7 be released as the main branch for git cloning? Also when will this be pushed to pip3?

[XuanYang-cn]

published, should be fixed.