milvus-io / milvus

A cloud-native vector database, storage for next generation AI applications
https://milvus.io
Apache License 2.0
30.36k stars 2.91k forks source link

[Bug]: [benchmark][standalone] Milvus search with errors"search_requests_with_expr() got multiple values for argument 'schema'" #21002

Closed jingkl closed 1 year ago

jingkl commented 1 year ago

Is there an existing issue for this?

Environment

- Milvus version:2.2.0-20221202-90ca7e1e
- Deployment mode(standalone or cluster):standalone
- SDK version(e.g. pymilvus v2.0.0rc2):2.2.1.dev3
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

server-instance fouram-tag-no-clean-4z7kk-1 server-configmap server-single-32c128m client-configmap client-random-locust-search-filter-100m-ddl

server:

fouram-tag-no-clean-4z7kk-1-etcd-0                                1/1     Running     0             23h     10.104.9.228   4am-node14   <none>           <none>
fouram-tag-no-clean-4z7kk-1-milvus-standalone-7cc968bbfb-gv22k    1/1     Running     0             23h     10.104.1.208   4am-node10   <none>           <none>
fouram-tag-no-clean-4z7kk-1-minio-7b5f584977-dw685                1/1     Running     0             23h     10.104.1.210   4am-node10   <none>           <none>

client log:

[2022-12-06 03:03:53,435] [   DEBUG] - [scene_test] Start flush : scene_test_5867_689997 (milvus_benchmark.client:643)
[2022-12-06 03:03:53,812] [   DEBUG] - [scene_test] Start drop : scene_test_6408_412223 (milvus_benchmark.client:658)
[2022-12-06 03:03:53,812] [    INFO] - Start Drop collection: scene_test_6408_412223 (milvus_benchmark.client:528)
[2022-12-06 03:03:53,881] [   DEBUG] - Drop collection scene_test_6408_412223 done. (milvus_benchmark.client:546)
[2022-12-06 03:03:53,881] [   DEBUG] - Milvus drop run in 0.0691s (milvus_benchmark.client:57)
[2022-12-06 03:03:53,881] [   DEBUG] - [scene_test]Scene test close : scene_test_6408_412223 (milvus_benchmark.client:660)
[2022-12-06 03:03:53,881] [   DEBUG] - Milvus scene_test run in 64.1733s (milvus_benchmark.client:57)
[2022-12-06 03:03:53,883] [   ERROR] - Unexcepted error: [search], search_requests_with_expr() got multiple values for argument 'sch
ema', <Time: {'RPC start': '2022-12-06 03:03:53.882055', 'Exception': '2022-12-06 03:03:53.883228'}> (pymilvus.decorators:120)
[2022-12-06 03:03:53,884] [   ERROR] - Unexcepted error: [search], search_requests_with_expr() got multiple values for argument 'sch
ema', <Time: {'RPC start': '2022-12-06 03:03:53.883485', 'Exception': '2022-12-06 03:03:53.884837'}> (pymilvus.decorators:120)
[2022-12-06 03:03:53,887] [   ERROR] - Unexcepted error: [search], search_requests_with_expr() got multiple values for argument 'sch
ema', <Time: {'RPC start': '2022-12-06 03:03:53.885420', 'Exception': '2022-12-06 03:03:53.887056'}> (pymilvus.decorators:120)
[2022-12-06 03:03:53,897] [   DEBUG] - Milvus get run in 0.0107s (milvus_benchmark.client:57)
[2022-12-06 03:03:53,908] [   DEBUG] - Milvus get run in 0.0101s (milvus_benchmark.client:57)
[2022-12-06 03:03:53,909] [   ERROR] - Unexcepted error: [search], search_requests_with_expr() got multiple values for argument 'sch
ema', <Time: {'RPC start': '2022-12-06 03:03:53.908488', 'Exception': '2022-12-06 03:03:53.909583'}> (pymilvus.decorators:120)
[2022-12-06 03:03:53,910] [   ERROR] - Unexcepted error: [search], search_requests_with_expr() got multiple values for argument 'sch
ema', <Time: {'RPC start': '2022-12-06 03:03:53.909821', 'Exception': '2022-12-06 03:03:53.910772'}> (pymilvus.decorators:120)
[2022-12-06 03:03:53,911] [   ERROR] - Unexcepted error: [search], search_requests_with_expr() got multiple values for argument 'sch
ema', <Time: {'RPC start': '2022-12-06 03:03:53.910983', 'Exception': '2022-12-06 03:03:53.911975'}> (pymilvus.decorators:120)
[2022-12-06 03:03:53,913] [   ERROR] - Unexcepted error: [search], search_requests_with_expr() got multiple values for argument 'sch
ema', <Time: {'RPC start': '2022-12-06 03:03:53.912235', 'Exception': '2022-12-06 03:03:53.913180'}> (pymilvus.decorators:120)
[2022-12-06 03:03:53,922] [   DEBUG] - Milvus get run in 0.0088s (milvus_benchmark.client:57)
[2022-12-06 03:03:53,923] [   ERROR] - Unexcepted error: [search], search_requests_with_expr() got multiple values for argument 'sch
ema', <Time: {'RPC start': '2022-12-06 03:03:53.922416', 'Exception': '2022-12-06 03:03:53.923519'}> (pymilvus.decorators:120)
[2022-12-06 03:03:53,924] [   ERROR] - Unexcepted error: [search], search_requests_with_expr() got multiple values for argument 'sch
ema', <Time: {'RPC start': '2022-12-06 03:03:53.923738', 'Exception': '2022-12-06 03:03:53.924704'}> (pymilvus.decorators:120)
[2022-12-06 03:03:53,934] [   DEBUG] - Milvus get run in 0.01s (milvus_benchmark.client:57)
[2022-12-06 03:03:53,936] [   ERROR] - Unexcepted error: [search], search_requests_with_expr() got multiple values for argument 'sch
ema', <Time: {'RPC start': '2022-12-06 03:03:53.935102', 'Exception': '2022-12-06 03:03:53.936184'}> (pymilvus.decorators:120)
[2022-12-06 03:03:53,946] [   DEBUG] - Milvus get run in 0.0099s (milvus_benchmark.client:57)

Expected Behavior

No response

Steps To Reproduce

1. create a collection
2. build ivfsq8 index
3. insert 100m data
4. build index again
5. load collection
6. search raise an error

Milvus Log

No response

Anything else?

locust_random_performance:
      collections:
        -
          collection_name: sift_100m_128_l2
          other_fields: float1
          ni_per: 50000
          build_index: true
          index_type: ivf_sq8
          index_param:
            nlist: 2048
          task:
            types:
              -
                type: query
                weight: 20
                params:
                  top_k: 10
                  nq: 10
                  search_param:
                    nprobe: 16
                  filters:
                    -
                      range: "{'range': {'float1': {'GT': -1.0, 'LT': collection_size * 0.5}}}"
              -
                type: load
                weight: 1
              -
                type: get
                weight: 10
                params:
                  ids_length: 10
              -
                type: scene_test
                weight: 2
            connection_num: 1
            clients_num: 20
            spawn_rate: 2
            during_time: 48h
yanliang567 commented 1 year ago

same as #21003

yanliang567 commented 1 year ago

close for dup to #21003