wangting0128
commented
2 weeks ago e2e case, same error
image: 2.5-20241029-eaed5b4b-amd64 test case name: test_query_function_calls
server: queryNode.segcore.multipleChunkedEnable=true
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
fouramf-e2e-9r5h5-etcd-0 1/1 Running 0 3h50m 10.104.24.217 4am-node29 <none> <none>
fouramf-e2e-9r5h5-etcd-1 1/1 Running 0 3h50m 10.104.23.144 4am-node27 <none> <none>
fouramf-e2e-9r5h5-etcd-2 1/1 Running 0 3h50m 10.104.19.167 4am-node28 <none> <none>
fouramf-e2e-9r5h5-milvus-datanode-565755d4dc-rrqkq 1/1 Running 0 3h50m 10.104.16.145 4am-node21 <none> <none>
fouramf-e2e-9r5h5-milvus-indexnode-dfdd757d-7pbl5 1/1 Running 0 3h50m 10.104.1.233 4am-node10 <none> <none>
fouramf-e2e-9r5h5-milvus-mixcoord-759c57f97c-kkpfm 1/1 Running 2 (3h49m ago) 3h50m 10.104.9.155 4am-node14 <none> <none>
fouramf-e2e-9r5h5-milvus-proxy-746689757c-844sn 1/1 Running 2 (3h49m ago) 3h50m 10.104.9.156 4am-node14 <none> <none>
fouramf-e2e-9r5h5-milvus-querynode-7bcb4c4d76-v5c78 1/1 Running 0 3h50m 10.104.15.246 4am-node20 <none> <none>
fouramf-e2e-9r5h5-minio-0 1/1 Running 0 3h50m 10.104.19.166 4am-node28 <none> <none>
fouramf-e2e-9r5h5-minio-1 1/1 Running 0 3h50m 10.104.24.218 4am-node29 <none> <none>
fouramf-e2e-9r5h5-minio-2 1/1 Running 0 3h50m 10.104.21.217 4am-node24 <none> <none>
fouramf-e2e-9r5h5-minio-3 1/1 Running 0 3h50m 10.104.20.116 4am-node22 <none> <none>
fouramf-e2e-9r5h5-pulsar-bookie-0 1/1 Running 0 3h50m 10.104.18.230 4am-node25 <none> <none>
fouramf-e2e-9r5h5-pulsar-bookie-1 1/1 Running 0 3h50m 10.104.24.220 4am-node29 <none> <none>
fouramf-e2e-9r5h5-pulsar-bookie-2 1/1 Running 0 3h50m 10.104.19.170 4am-node28 <none> <none>
fouramf-e2e-9r5h5-pulsar-bookie-init-8nz7d 0/1 Completed 0 3h50m 10.104.15.212 4am-node20 <none> <none>
fouramf-e2e-9r5h5-pulsar-broker-0 1/1 Running 0 3h50m 10.104.5.130 4am-node12 <none> <none>
fouramf-e2e-9r5h5-pulsar-proxy-0 1/1 Running 0 3h50m 10.104.1.229 4am-node10 <none> <none>
fouramf-e2e-9r5h5-pulsar-pulsar-init-k2pjp 0/1 Completed 0 3h50m 10.104.6.48 4am-node13 <none> <none>
fouramf-e2e-9r5h5-pulsar-recovery-0 1/1 Running 0 3h50m 10.104.17.152 4am-node23 <none> <none>
fouramf-e2e-9r5h5-pulsar-zookeeper-0 1/1 Running 0 3h50m 10.104.23.145 4am-node27 <none> <none>
fouramf-e2e-9r5h5-pulsar-zookeeper-1 1/1 Running 0 3h49m 10.104.16.101 4am-node21 <none> <none>
fouramf-e2e-9r5h5-pulsar-zookeeper-2 1/1 Running 0 3h48m 10.104.34.222 4am-node37 <none> <none>client log:
@pytest.mark.tags(CaseLabel.L1)
def test_query_function_calls(self):
"""
target: test query data
method: create collection and insert data
query with mix call expr in string field and int field
expected: query successfully
"""
collection_w, vectors = self.init_collection_general(prefix, insert_data=True,
primary_field=ct.default_string_field_name)[0:2]
res = vectors[0].iloc[:, 1:3].to_dict('records')
output_fields = [default_float_field_name, default_string_field_name]
for mixed_call_expr in [
"not empty(varchar) && int64 >= 0",
# function call is case-insensitive
"not EmPty(varchar) && int64 >= 0",
"not EMPTY(varchar) && int64 >= 0",
"starts_with(varchar, varchar) && int64 >= 0",
]:
> collection_w.query(
mixed_call_expr,
output_fields=output_fields,
check_task=CheckTasks.check_query_results,
check_items={exp_res: res},
)
test_query.py:5678:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
../utils/wrapper.py:33: in inner_wrapper
res, result = func(*args, **kwargs)
../base/collection_wrapper.py:218: in query
check_result = ResponseChecker(res, func_name, check_task, check_items, check,
../check/func_check.py:65: in run
result = self.check_query_results(self.response, self.func_name, self.check_items)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
query_res = Error(code=65535, message=fail to Query on QueryNode 3: worker(3) query failed: Operator::GetOutput failed for [Operat...an() interface is not implemented for variable column at /workspace/source/internal/core/src/mmap/ChunkedColumn.h:304
)
func_name = 'query'
check_items = {'exp_res': [{'float': 0.0, 'varchar': '0'}, {'float': 1.0, 'varchar': '1'}, {'float': 2.0, 'varchar': '2'}, {'float': 3.0, 'varchar': '3'}, {'float': 4.0, 'varchar': '4'}, {'float': 5.0, 'varchar': '5'}, ...]}
@staticmethod
def check_query_results(query_res, func_name, check_items):
"""
According to the check_items to check actual query result, which return from func_name.
:param: query_res: A list that contains all results
:type: list
:param func_name: Query API name
:type func_name: str
:param check_items: The items expected to be checked, including exp_res, with_vec
The type of exp_res value is as same as query_res
The type of with_vec value is bool, True value means check vector field, False otherwise
:type check_items: dict
"""
if func_name != 'query':
log.warning("The function name is {} rather than {}".format(func_name, "query"))
if not isinstance(query_res, list):
> raise Exception("The query result to check isn't list type object")
E Exception: The query result to check isn't list type object
../check/func_check.py:432: Exception
------------------------------ Captured log setup ------------------------------
[2024-10-29 09:14:05 - INFO - ci_test]: [setup_class] Start setup class... (client_base.py:41)
[2024-10-29 09:14:05 - INFO - ci_test]: *********************************** setup *********************************** (client_base.py:47)
[2024-10-29 09:14:05 - INFO - ci_test]: pymilvus version: 2.5.0rc104 (client_base.py:48)
[2024-10-29 09:14:05 - INFO - ci_test]: [setup_method] Start setup test case test_query_function_calls. (client_base.py:49)
------------------------------ Captured log call -------------------------------
[2024-10-29 09:14:05 - INFO - ci_test]: Test case of search interface: initialize before test case (client_base.py:262)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_request) : [Connections.has_connection] args: ['default'], kwargs: {} (api_request.py:62)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_response) : False (api_request.py:37)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_request) : [Connections.connect] args: ['default', '', '', 'default', ''], kwargs: {'host': 'fouramf-e2e-9r5h5-milvus.qa-milvus.svc.cluster.local', 'port': 19530} (api_request.py:62)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_response) : None (api_request.py:37)
[2024-10-29 09:14:05 - INFO - ci_test]: server version: eaed5b4 (client_base.py:166)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_request) : [FieldSchema] args: ['int64', <DataType.INT64: 5>, ''], kwargs: {'is_primary': False, 'is_partition_key': False, 'nullable': False} (api_request.py:62)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_response) : {'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>} (api_request.py:37)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_request) : [FieldSchema] args: ['varchar', <DataType.VARCHAR: 21>, ''], kwargs: {'max_length': 65535, 'is_primary': False, 'is_partition_key': False, 'nullable': False} (api_request.py:62)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_response) : {'name': 'varchar', 'description': '', 'type': <DataType.VARCHAR: 21>, 'params': {'max_length': 65535}} (api_request.py:37)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_request) : [FieldSchema] args: ['float_vector', <DataType.FLOAT_VECTOR: 101>, ''], kwargs: {'dim': 128, 'is_primary': False, 'nullable': False} (api_request.py:62)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_response) : {'name': 'float_vector', 'description': '', 'type': <DataType.FLOAT_VECTOR: 101>, 'params': {'dim': 128}} (api_request.py:37)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_request) : [FieldSchema] args: ['float', <DataType.FLOAT: 10>, ''], kwargs: {'is_primary': False, 'nullable': False} (api_request.py:62)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_response) : {'name': 'float', 'description': '', 'type': <DataType.FLOAT: 10>} (api_request.py:37)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_request) : [FieldSchema] args: ['json_field', <DataType.JSON: 23>, ''], kwargs: {'is_primary': False, 'nullable': False} (api_request.py:62)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_response) : {'name': 'json_field', 'description': '', 'type': <DataType.JSON: 23>} (api_request.py:37)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_request) : [CollectionSchema] args: [[{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>}, {'name': 'float', 'description': '', 'type': <DataType.FLOAT: 10>}, {'name': 'varchar', 'description': '', 'type': <DataType.VARCHAR: 21>, 'params': {'max_length': 65535}}, {'name': 'json_field', 'description': '', 'type': <DataTyp......, kwargs: {'primary_field': 'varchar', 'auto_id': False, 'enable_dynamic_field': False} (api_request.py:62)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_response) : {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>}, {'name': 'float', 'description': '', 'type': <DataType.FLOAT: 10>}, {'name': 'varchar', 'description': '', 'type': <DataType.VARCHAR: 21>, 'params': {'max_length': 65535}, 'is_primary'...... (api_request.py:37)
[2024-10-29 09:14:05 - INFO - ci_test]: init_collection_general: collection creation (client_base.py:306)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_request) : [Connections.has_connection] args: ['default'], kwargs: {} (api_request.py:62)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_response) : True (api_request.py:37)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_request) : [Collection] args: ['query_yPgQI7Eb', {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>}, {'name': 'float', 'description': '', 'type': <DataType.FLOAT: 10>}, {'name': 'varchar', 'description': '', 'type': <DataType.VARCHAR: 21>, 'params': {'max_length': 6......, kwargs: {'consistency_level': 'Strong'} (api_request.py:62)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_response) : <Collection>:
-------------
<name>: query_yPgQI7Eb
<description>:
<schema>: {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>}, {'name': 'float', 'description': '', 'type': <DataType.FLOAT: 10>}, {'name': 'varchar', 'description': '', ...... (api_request.py:37)
[2024-10-29 09:14:05 - INFO - ci_test]: inserting 2000 data into collection query_yPgQI7Eb (common_func.py:2705)
[2024-10-29 09:14:05 - DEBUG - ci_test]: Dynamic field is enabled: False (common_func.py:2710)
[2024-10-29 09:14:05 - DEBUG - ci_test]: (api_request) : [Collection.insert] args: [ int64 float varchar json_field float_vector
0 0 0.0 0 {'number': 0, 'float': 0.0} [0.09061300659385457, 0.1337348786921125, 0.09...
1 1 1.0 1 {'number': 1, 'float': 1.0} [0.0814......, kwargs: {'timeout': 180} (api_request.py:62)
[2024-10-29 09:14:06 - DEBUG - ci_test]: (api_response) : (insert count: 2000, delete count: 0, upsert count: 0, timestamp: 453559778265268228, success count: 2000, err count: 0 (api_request.py:37)
[2024-10-29 09:14:06 - INFO - ci_test]: inserted 2000 data into collection query_yPgQI7Eb (common_func.py:2775)
[2024-10-29 09:14:06 - DEBUG - ci_test]: (api_request) : [Collection.flush] args: [], kwargs: {'timeout': 180} (api_request.py:62)
[2024-10-29 09:14:10 - DEBUG - ci_test]: (api_response) : None (api_request.py:37)
[2024-10-29 09:14:10 - DEBUG - ci_test]: (api_request) : [Collection.flush] args: [], kwargs: {'timeout': 180} (api_request.py:62)
[2024-10-29 09:14:18 - DEBUG - ci_test]: (api_response) : None (api_request.py:37)
[2024-10-29 09:14:18 - DEBUG - ci_test]: (api_request) : [Collection.create_index] args: ['float_vector', {'index_type': 'FLAT', 'params': {}, 'metric_type': 'COSINE'}, 1200], kwargs: {'index_name': ''} (api_request.py:62)
[2024-10-29 09:14:20 - DEBUG - ci_test]: (api_response) : Status(code=0, message=) (api_request.py:37)
[2024-10-29 09:14:20 - DEBUG - ci_test]: (api_request) : [Collection.load] args: [None, 1, 180], kwargs: {} (api_request.py:62)
[2024-10-29 09:14:21 - DEBUG - ci_test]: (api_response) : None (api_request.py:37)
[2024-10-29 09:14:21 - DEBUG - ci_test]: (api_request) : [Collection.query] args: ['not empty(varchar) && int64 >= 0', ['float', 'varchar'], None, 180], kwargs: {} (api_request.py:62)
[2024-10-29 09:14:22 - ERROR - pymilvus.decorators]: RPC error: [query], <MilvusException: (code=65535, message=fail to Query on QueryNode 3: worker(3) query failed: Operator::GetOutput failed for [Operator:PhyFilterBitsNode, plan node id: 14972] : => span() interface is not implemented for variable column at /workspace/source/internal/core/src/mmap/ChunkedColumn.h:304
)>, <Time:{'RPC start': '2024-10-29 09:14:21.872553', 'RPC error': '2024-10-29 09:14:22.739207'}> (decorators.py:140)
[2024-10-29 09:14:22 - ERROR - ci_test]: Traceback (most recent call last):
File "/src/milvus/tests/python_client/utils/api_request.py", line 32, in inner_wrapper
res = func(*args, **_kwargs)
File "/src/milvus/tests/python_client/utils/api_request.py", line 63, in api_request
return func(*arg, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/pymilvus/orm/collection.py", line 1076, in query
return conn.query(
File "/usr/local/lib/python3.8/dist-packages/pymilvus/decorators.py", line 141, in handler
raise e from e
File "/usr/local/lib/python3.8/dist-packages/pymilvus/decorators.py", line 137, in handler
return func(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/pymilvus/decorators.py", line 176, in handler
return func(self, *args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/pymilvus/decorators.py", line 116, in handler
raise e from e
File "/usr/local/lib/python3.8/dist-packages/pymilvus/decorators.py", line 86, in handler
return func(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/pymilvus/client/grpc_handler.py", line 1541, in query
check_status(response.status)
File "/usr/local/lib/python3.8/dist-packages/pymilvus/client/utils.py", line 63, in check_status
raise MilvusException(status.code, status.reason, status.error_code)
pymilvus.exceptions.MilvusException: <MilvusException: (code=65535, message=fail to Query on QueryNode 3: worker(3) query failed: Operator::GetOutput failed for [Operator:PhyFilterBitsNode, plan node id: 14972] : => span() interface is not implemented for variable column at /workspace/source/internal/core/src/mmap/ChunkedColumn.h:304
)>
(api_request.py:45)
[2024-10-29 09:14:22 - ERROR - ci_test]: (api_response) : <MilvusException: (code=65535, message=fail to Query on QueryNode 3: worker(3) query failed: Operator::GetOutput failed for [Operator:PhyFilterBitsNode, plan node id: 14972] : => span() interface is not implemented for variable column at /workspace/source/internal/core/src/mmap/ChunkedColumn.h:304
...... (api_request.py:46)
liliu-z
NicoYuan1986
Is there an existing issue for this?
Environment
Current Behavior
argo task: memory-opt-scenes-mn2cd test case name: test_bitmap_locust_dql_dml_standalone
server:
client error log:
Expected Behavior
No response
Steps To Reproduce
Milvus Log
No response
Anything else?
test result: