search

milvus-io / milvus

A cloud-native vector database, storage for next generation AI applications
https://milvus.io
Apache License 2.0
30.89k stars 2.94k forks source link

[Bug]: When using the LIKE expression for querying, an error message that does not meet expectations occurs during stress testing. #36492

Closed zhuwenxing closed 1 week ago

zhuwenxing commented 1 month ago

Is there an existing issue for this?

Environment

- Milvus version:master-20240924-df7ae088-amd64
- Deployment mode(standalone or cluster):cluster
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

error message is [2024-09-24T08:47:32.204Z] {"code":4,"message":"request limit exceeded[limit=1024]"} but my test code is 

    @tag('like')
    @task
    def query_with_like(self):
        with self.client.post("/v2/vectordb/entities/query",
                              json={"collectionName": "test_text_match_perf",
                                    "outputFields": ["id"],
                                    "filter": self.like_filter,
                                    "limit": 1000
                                    },
                              headers={"Content-Type": "application/json", "Authorization": "Bearer root:Milvus"},
                              catch_response=True
                              ) as resp:
            if resp.status_code != 200 or resp.json()["code"] != 0:
                resp.failure(f"query failed with error {resp.text}")
                print(resp.text)
            else:
                pass

and as you can see, the limit is set as 1000

Expected Behavior

No response

Steps To Reproduce

No response

Milvus Log

failed job: https://qa-jenkins.milvus.io/blue/organizations/jenkins/text_match_perf_test/detail/text_match_perf_test/9/pipeline/186 log:artifacts-text-match-test-9-server-logs (1).tar.gz

cluster:4am ns: chaos-testing pod info

[2024-09-24T08:18:43.592Z] + + kubectl getgrep pods text-match-test-9 -o

[2024-09-24T08:18:43.594Z]  wide

[2024-09-24T08:18:44.193Z] text-match-test-9-etcd-0                                          1/1     Running       0                3m51s   10.104.15.30    4am-node20   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-etcd-1                                          1/1     Running       0                3m51s   10.104.17.65    4am-node23   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-etcd-2                                          1/1     Running       0                3m51s   10.104.25.185   4am-node30   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-milvus-datanode-9f8bfb885-45tdl                 1/1     Running       2 (3m28s ago)    3m51s   10.104.4.92     4am-node11   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-milvus-datanode-9f8bfb885-njj5s                 1/1     Running       2 (3m25s ago)    3m51s   10.104.13.112   4am-node16   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-milvus-datanode-9f8bfb885-t56jp                 1/1     Running       2 (3m28s ago)    3m51s   10.104.5.8      4am-node12   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-milvus-indexnode-dc8567848-5d2g9                1/1     Running       2 (3m28s ago)    3m51s   10.104.16.60    4am-node21   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-milvus-indexnode-dc8567848-drjkz                1/1     Running       2 (3m28s ago)    3m51s   10.104.21.247   4am-node24   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-milvus-indexnode-dc8567848-zz4xm                1/1     Running       2 (3m28s ago)    3m51s   10.104.6.69     4am-node13   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-milvus-mixcoord-86c5fcd47-x6srr                 1/1     Running       2 (3m28s ago)    3m51s   10.104.4.89     4am-node11   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-milvus-proxy-5b44dcfc6c-9n7dq                   1/1     Running       2 (3m25s ago)    3m51s   10.104.13.111   4am-node16   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-milvus-querynode-68cfb7584b-9g25w               1/1     Running       2 (3m25s ago)    3m51s   10.104.17.63    4am-node23   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-milvus-querynode-68cfb7584b-ghrv2               1/1     Running       2 (3m29s ago)    3m51s   10.104.21.246   4am-node24   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-minio-0                                         1/1     Running       0                3m51s   10.104.15.31    4am-node20   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-minio-1                                         1/1     Running       0                3m51s   10.104.25.182   4am-node30   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-minio-2                                         1/1     Running       0                3m51s   10.104.17.66    4am-node23   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-minio-3                                         1/1     Running       0                3m50s   10.104.23.184   4am-node27   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-pulsar-bookie-0                                 1/1     Running       0                3m51s   10.104.15.32    4am-node20   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-pulsar-bookie-1                                 1/1     Running       0                3m51s   10.104.25.184   4am-node30   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-pulsar-bookie-init-pbk5j                        0/1     Completed     0                3m51s   10.104.4.90     4am-node11   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-pulsar-broker-0                                 1/1     Running       0                3m51s   10.104.13.110   4am-node16   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-pulsar-proxy-0                                  1/1     Running       0                3m51s   10.104.6.68     4am-node13   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-pulsar-pulsar-init-6v2tx                        0/1     Completed     0                3m51s   10.104.4.91     4am-node11   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-pulsar-recovery-0                               1/1     Running       0                3m51s   10.104.13.113   4am-node16   <none>           <none>

[2024-09-24T08:18:44.193Z] text-match-test-9-pulsar-zookeeper-0                              1/1     Running       0                3m51s   10.104.25.186   4am-node30   <none>           <none>

Anything else?

No response

yanliang567 commented 1 month ago

/assign @sunby /unassign

xiaofan-luan commented 1 month ago

I thought this could likely be a restful v2 issue

stale[bot] commented 3 weeks ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

xiaofan-luan commented 1 week ago

@zhuwenxing

could you verify on the issue?