search

milvus-io / milvus

A cloud-native vector database, storage for next generation AI applications
https://milvus.io
Apache License 2.0
30.48k stars 2.92k forks source link

[Bug]: The RT of the first query executed on a newly loaded collection is relatively long #37059

Closed wangting0128 closed 3 weeks ago

wangting0128 commented 3 weeks ago

Is there an existing issue for this?

Environment

- Milvus version:2.4-20241021-1dcc393e-amd64
- Deployment mode(standalone or cluster):cluster
- MQ type(rocksmq, pulsar or kafka):pulsar    
- SDK version(e.g. pymilvus v2.0.0rc2):2.4.8
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

argo task: fouramf-l644c

server:

NAME                                                          READY   STATUS             RESTARTS        AGE     IP              NODE         NOMINATED NODE   READINESS GATES
query-perf-compare-etcd-0                                     1/1     Running            0               5h15m   10.104.23.116   4am-node27   <none>           <none>
query-perf-compare-etcd-1                                     1/1     Running            0               5h16m   10.104.32.162   4am-node39   <none>           <none>
query-perf-compare-etcd-2                                     1/1     Running            0               5h17m   10.104.17.52    4am-node23   <none>           <none>
query-perf-compare-milvus-datanode-86fcd77c8-l5jqr            1/1     Running            0               5h17m   10.104.34.85    4am-node37   <none>           <none>
query-perf-compare-milvus-indexnode-7ccf5b5cc-jr7vh           1/1     Running            0               5h17m   10.104.34.86    4am-node37   <none>           <none>
query-perf-compare-milvus-indexnode-7ccf5b5cc-m5t7w           1/1     Running            0               5h17m   10.104.18.243   4am-node25   <none>           <none>
query-perf-compare-milvus-indexnode-7ccf5b5cc-mf9mx           1/1     Running            0               5h15m   10.104.15.174   4am-node20   <none>           <none>
query-perf-compare-milvus-indexnode-7ccf5b5cc-v6whl           1/1     Running            0               5h15m   10.104.16.109   4am-node21   <none>           <none>
query-perf-compare-milvus-mixcoord-677b55b59-zrxzh            1/1     Running            0               5h17m   10.104.34.88    4am-node37   <none>           <none>
query-perf-compare-milvus-proxy-76fff8cc9-cgckb               1/1     Running            0               5h17m   10.104.34.87    4am-node37   <none>           <none>
query-perf-compare-milvus-querynode-f65899674-88b62           1/1     Running            0               94m     10.104.18.49    4am-node25   <none>           <none>
query-perf-compare-milvus-querynode-f65899674-hpcj6           1/1     Running            0               97m     10.104.20.4     4am-node22   <none>           <none>
query-perf-compare-milvus-querynode-f65899674-k9dk9           1/1     Running            0               96m     10.104.32.50    4am-node39   <none>           <none>
query-perf-compare-minio-0                                    1/1     Running            0               23h     10.104.23.9     4am-node27   <none>           <none>
query-perf-compare-minio-1                                    1/1     Running            0               23h     10.104.32.100   4am-node39   <none>           <none>
query-perf-compare-minio-2                                    1/1     Running            0               23h     10.104.17.143   4am-node23   <none>           <none>
query-perf-compare-minio-3                                    1/1     Running            0               23h     10.104.27.247   4am-node31   <none>           <none>
query-perf-compare-pulsar-bookie-0                            1/1     Running            0               23h     10.104.23.8     4am-node27   <none>           <none>
query-perf-compare-pulsar-bookie-1                            1/1     Running            0               23h     10.104.27.245   4am-node31   <none>           <none>
query-perf-compare-pulsar-bookie-2                            1/1     Running            0               23h     10.104.32.104   4am-node39   <none>           <none>
query-perf-compare-pulsar-broker-0                            1/1     Running            0               23h     10.104.1.21     4am-node10   <none>           <none>
query-perf-compare-pulsar-proxy-0                             1/1     Running            0               23h     10.104.14.177   4am-node18   <none>           <none>
query-perf-compare-pulsar-recovery-0                          1/1     Running            0               23h     10.104.5.110    4am-node12   <none>           <none>
query-perf-compare-pulsar-zookeeper-0                         1/1     Running            0               23h     10.104.23.2     4am-node27   <none>           <none>
query-perf-compare-pulsar-zookeeper-1                         1/1     Running            0               23h     10.104.32.106   4am-node39   <none>           <none>
query-perf-compare-pulsar-zookeeper-2                         1/1     Running            0               23h     10.104.17.147   4am-node23   <none>           <none>

client logs: img_v3_02ft_0087779f-82f3-4f6a-b30e-71d50017471g

[2024-10-22 07:37:48,297 -  INFO - fouram]: [Base] Collection schema: 
{'auto_id': False,
 'description': '',
 'fields': [{'name': 'id', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'float_vector', 'description': '', 'type': <DataType.FLOAT_VECTOR: 101>, 'params': {'dim': 768}},
            {'name': 'varchar_uri', 'description': '', 'type': <DataType.VARCHAR: 21>, 'params': {'max_length': 65535}}, {'name': 'varchar_noindex', 'description': '', 'type': <DataType.VARCHAR: 21>, 'params': {'max_length': 65535}},
            {'name': 'varchar_inverted', 'description': '', 'type': <DataType.VARCHAR: 21>, 'params': {'max_length': 65535}}, {'name': 'int64_noindex', 'description': '', 'type': <DataType.INT64: 5>},
            {'name': 'int64_inverted', 'description': '', 'type': <DataType.INT64: 5>}],
 'enable_dynamic_field': False}
[2024-10-22 07:37:50,422 -  INFO - fouram]: [Base] Index params of fouram_GA5xqUC9:[{'int64_inverted': {'index_type': 'INVERTED'}}, {'float_vector': {'index_type': 'IVF_SQ8', 'metric_type': 'L2', 'params': {'nlist': 1024}}}, {'varchar_inverted': {'index_type': 'INVERTED'}}] (base.py:488)
[2024-10-22 07:37:50,426 -  INFO - fouram]: [Base] Collection fouram_GA5xqUC9 replicas info - Replica groups:
- Group: <group_id:453378919289585665>, <group_nodes:(24, 23, 22)>, <shards:[Shard: <channel_name:by-dev-rootcoord-dml_0_453378863286190286v0>, <shard_leader:23>, <shard_nodes:{24, 22, 23}>]>, <resource_group: __default_resource_group>, <num_outbound_node: {}> (base.py:744)
[2024-10-22 07:37:50,430 -  INFO - fouram]: [Base] Parser segment info: 
{'segment_counts': 31,
 'segment_total_vectors': 10000000,
 'max_segment_raw_count': 410000,
 'min_segment_raw_count': 120000,
 'avg_segment_raw_count': 322580.6,
 'std_segment_raw_count': 60480.2,
 'shards_num': 1,
 'truncated_avg_segment_raw_count': 329333.3,
 'truncated_std_segment_raw_count': 48643.8,
 'top_percentile': [{'TP_10': 300000.0},
                    {'TP_20': 320000.0},
                    {'TP_30': 320000.0},
                    {'TP_40': 320000.0},
                    {'TP_50': 320000.0},
                    {'TP_60': 320000.0},
                    {'TP_70': 350000.0},
                    {'TP_80': 360000.0},
                    {'TP_90': 380000.0}]} (base.py:751)
[2024-10-22 07:37:50,431 -  INFO - fouram]: [PerfTemplate] Actual parameters used: {'dataset_params': {'metric_type': 'L2', 'column_name': 'float32_vector', 'dim': 768, 'max_length': 65535, 'scalars_index': {'varchar_inverted': {'index_type': 'INVERTED'}, 'int64_inverted': {'index_type': 'INVERTED'}}, 'scalars_params': {'varchar_uri': {'other_params': {'dataset': 'laion2b_url'}}}, 'dataset_name': 'laion2b_multi', 'dataset_size': '10m', 'ni_per': 10000, 'req_run_counts': 50}, 'collection_params': {'other_fields': ['varchar_uri', 'varchar_noindex', 'varchar_inverted', 'int64_noindex', 'int64_inverted'], 'shards_num': 1}, 'query_params': {'expr': '0 < int64_noindex <= 1000000', 'limit': 100}, 'index_params': {'index_type': 'IVF_SQ8', 'index_param': {'nlist': 1024}}} (performance_template.py:67)
[2024-10-22 07:37:50,431 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,456 -  INFO - fouram]: [Time] Collection.query run in 0.0248s (api_request.py:49)
[2024-10-22 07:37:50,456 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,463 -  INFO - fouram]: [Time] Collection.query run in 0.0067s (api_request.py:49)
[2024-10-22 07:37:50,463 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,470 -  INFO - fouram]: [Time] Collection.query run in 0.0064s (api_request.py:49)
[2024-10-22 07:37:50,470 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,478 -  INFO - fouram]: [Time] Collection.query run in 0.0078s (api_request.py:49)
[2024-10-22 07:37:50,478 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,487 -  INFO - fouram]: [Time] Collection.query run in 0.0082s (api_request.py:49)
[2024-10-22 07:37:50,487 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,493 -  INFO - fouram]: [Time] Collection.query run in 0.0059s (api_request.py:49)
[2024-10-22 07:37:50,493 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,498 -  INFO - fouram]: [Time] Collection.query run in 0.0053s (api_request.py:49)
[2024-10-22 07:37:50,499 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,504 -  INFO - fouram]: [Time] Collection.query run in 0.0051s (api_request.py:49)
[2024-10-22 07:37:50,504 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,509 -  INFO - fouram]: [Time] Collection.query run in 0.0049s (api_request.py:49)
[2024-10-22 07:37:50,509 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,514 -  INFO - fouram]: [Time] Collection.query run in 0.0045s (api_request.py:49)
[2024-10-22 07:37:50,514 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,518 -  INFO - fouram]: [Time] Collection.query run in 0.0043s (api_request.py:49)
[2024-10-22 07:37:50,518 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,524 -  INFO - fouram]: [Time] Collection.query run in 0.0052s (api_request.py:49)
[2024-10-22 07:37:50,524 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,529 -  INFO - fouram]: [Time] Collection.query run in 0.0051s (api_request.py:49)
[2024-10-22 07:37:50,529 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,534 -  INFO - fouram]: [Time] Collection.query run in 0.0048s (api_request.py:49)
[2024-10-22 07:37:50,534 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,540 -  INFO - fouram]: [Time] Collection.query run in 0.0053s (api_request.py:49)
[2024-10-22 07:37:50,540 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,546 -  INFO - fouram]: [Time] Collection.query run in 0.0062s (api_request.py:49)
[2024-10-22 07:37:50,546 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,552 -  INFO - fouram]: [Time] Collection.query run in 0.0055s (api_request.py:49)
[2024-10-22 07:37:50,552 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,557 -  INFO - fouram]: [Time] Collection.query run in 0.005s (api_request.py:49)
[2024-10-22 07:37:50,557 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,562 -  INFO - fouram]: [Time] Collection.query run in 0.0052s (api_request.py:49)
[2024-10-22 07:37:50,562 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,567 -  INFO - fouram]: [Time] Collection.query run in 0.0048s (api_request.py:49)
[2024-10-22 07:37:50,567 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,572 -  INFO - fouram]: [Time] Collection.query run in 0.0046s (api_request.py:49)
[2024-10-22 07:37:50,572 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,577 -  INFO - fouram]: [Time] Collection.query run in 0.0047s (api_request.py:49)
[2024-10-22 07:37:50,577 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,584 -  INFO - fouram]: [Time] Collection.query run in 0.0062s (api_request.py:49)
[2024-10-22 07:37:50,584 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,589 -  INFO - fouram]: [Time] Collection.query run in 0.0052s (api_request.py:49)
[2024-10-22 07:37:50,589 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,595 -  INFO - fouram]: [Time] Collection.query run in 0.0055s (api_request.py:49)
[2024-10-22 07:37:50,595 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,600 -  INFO - fouram]: [Time] Collection.query run in 0.0049s (api_request.py:49)
[2024-10-22 07:37:50,600 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,605 -  INFO - fouram]: [Time] Collection.query run in 0.005s (api_request.py:49)
[2024-10-22 07:37:50,605 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,610 -  INFO - fouram]: [Time] Collection.query run in 0.0045s (api_request.py:49)
[2024-10-22 07:37:50,610 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,615 -  INFO - fouram]: [Time] Collection.query run in 0.0053s (api_request.py:49)
[2024-10-22 07:37:50,616 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,620 -  INFO - fouram]: [Time] Collection.query run in 0.0047s (api_request.py:49)
[2024-10-22 07:37:50,620 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,625 -  INFO - fouram]: [Time] Collection.query run in 0.0047s (api_request.py:49)
[2024-10-22 07:37:50,625 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,630 -  INFO - fouram]: [Time] Collection.query run in 0.0048s (api_request.py:49)
[2024-10-22 07:37:50,630 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,635 -  INFO - fouram]: [Time] Collection.query run in 0.0048s (api_request.py:49)
[2024-10-22 07:37:50,635 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,641 -  INFO - fouram]: [Time] Collection.query run in 0.0055s (api_request.py:49)
[2024-10-22 07:37:50,641 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,646 -  INFO - fouram]: [Time] Collection.query run in 0.0049s (api_request.py:49)
[2024-10-22 07:37:50,646 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,656 -  INFO - fouram]: [Time] Collection.query run in 0.0093s (api_request.py:49)
[2024-10-22 07:37:50,656 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,661 -  INFO - fouram]: [Time] Collection.query run in 0.0047s (api_request.py:49)
[2024-10-22 07:37:50,661 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,666 -  INFO - fouram]: [Time] Collection.query run in 0.0051s (api_request.py:49)
[2024-10-22 07:37:50,666 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,671 -  INFO - fouram]: [Time] Collection.query run in 0.0047s (api_request.py:49)
[2024-10-22 07:37:50,671 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,676 -  INFO - fouram]: [Time] Collection.query run in 0.0046s (api_request.py:49)
[2024-10-22 07:37:50,676 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,681 -  INFO - fouram]: [Time] Collection.query run in 0.0051s (api_request.py:49)
[2024-10-22 07:37:50,681 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,686 -  INFO - fouram]: [Time] Collection.query run in 0.005s (api_request.py:49)
[2024-10-22 07:37:50,686 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,700 -  INFO - fouram]: [Time] Collection.query run in 0.0139s (api_request.py:49)
[2024-10-22 07:37:50,701 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,707 -  INFO - fouram]: [Time] Collection.query run in 0.006s (api_request.py:49)
[2024-10-22 07:37:50,707 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,715 -  INFO - fouram]: [Time] Collection.query run in 0.0078s (api_request.py:49)
[2024-10-22 07:37:50,715 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,720 -  INFO - fouram]: [Time] Collection.query run in 0.0049s (api_request.py:49)
[2024-10-22 07:37:50,720 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,725 -  INFO - fouram]: [Time] Collection.query run in 0.0049s (api_request.py:49)
[2024-10-22 07:37:50,725 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,734 -  INFO - fouram]: [Time] Collection.query run in 0.0087s (api_request.py:49)
[2024-10-22 07:37:50,734 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,741 -  INFO - fouram]: [Time] Collection.query run in 0.0065s (api_request.py:49)
[2024-10-22 07:37:50,741 -  INFO - fouram]: [Base] expr of query: "0 < int64_noindex <= 1000000", kwargs:{'limit': 100} (base.py:548)
[2024-10-22 07:37:50,746 -  INFO - fouram]: [Time] Collection.query run in 0.0047s (api_request.py:49)
[2024-10-22 07:37:50,747 -  INFO - fouram]: [PerfTemplate] Report data: 
{'server': {'deploy_tool': '',
            'deploy_mode': '',
            'config_name': '',
            'config': {},
            'host': 'query-perf-compare-milvus.qa-milvus.svc.cluster.local',
            'port': '19530',
            'uri': ''},
 'client': {'test_case_type': 'Query',
            'test_case_name': 'test_query_expr_custom_parameters',
            'test_case_params': {'dataset_params': {'metric_type': 'L2',
                                                    'column_name': 'float32_vector',
                                                    'dim': 768,
                                                    'max_length': 65535,
                                                    'scalars_index': {'varchar_inverted': {'index_type': 'INVERTED'},
                                                                      'int64_inverted': {'index_type': 'INVERTED'}},
                                                    'scalars_params': {'varchar_uri': {'other_params': {'dataset': 'laion2b_url'}}},
                                                    'dataset_name': 'laion2b_multi',
                                                    'dataset_size': '10m',
                                                    'ni_per': 10000,
                                                    'req_run_counts': 50},
                                 'collection_params': {'other_fields': ['varchar_uri',
                                                                        'varchar_noindex',
                                                                        'varchar_inverted',
                                                                        'int64_noindex',
                                                                        'int64_inverted'],
                                                       'shards_num': 1},
                                 'query_params': {'expr': '0 < int64_noindex '
                                                          '<= 1000000',
                                                  'limit': 100},
                                 'index_params': {'index_type': 'IVF_SQ8',
                                                  'index_param': {'nlist': 1024}}},
            'run_id': 2024102226685487,
            'datetime': '2024-10-22 07:37:48.257260',
            'client_version': '2.2'},
 'result': {'test_result': {'flush': {'RT': 0.5431},
                            'index': {'RT': 0.5261,
                                      'varchar_inverted': {'RT': 0.5175},
                                      'int64_inverted': {'RT': 0.5177}},
                            'load': {'RT': 0.0056},
                            'query': {'RT': 0.006,
                                      'MinRT': 0.0043,
                                      'MaxRT': 0.0248,
                                      'TP99': 0.0195,
                                      'TP95': 0.009}}}}

Expected Behavior

No response

Steps To Reproduce

1. create a collection with fields: ['id', 'float_vector', 'varchar_uri', 'varchar_noindex', 'varchar_inverted', 'int64_noindex', 'int64_inverted']
2. build index 
  - IVF_SQ8: float_vector
  - INVERTED: varchar_inverted, int64_inverted
3. insert 10m data
4. flush 
5. build index again
6. load collection
7. serial query

Milvus Log

No response

Anything else?

No response

xiaofan-luan commented 3 weeks ago

don't think this is a issue. skip it for now