milvus-io / milvus

A cloud-native vector database, storage for next generation AI applications
https://milvus.io
Apache License 2.0
31.13k stars 2.95k forks source link

[Bug]: list_bulk_insert_tasks returns missing fields #38172

Open abd-770 opened 1 day ago

abd-770 commented 1 day ago

Is there an existing issue for this?

Environment

- Milvus version:
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

Running bulk insert and use list_bulk_insert_tasks to check the status

id = utility.do_bulk_insert(collection_name=collection_name, files=['bulk/json/01/1.json'])
tasks = utility.list_bulk_insert_tasks()
for task in tasks:
  print(task)

Output:

<Bulk insert state:
    - taskID          : 0,
    - state           : Completed,
    - row_count       : 0,
    - infos           : {'failed_reason': '', 'progress_percent': '100'},
    - id_ranges       : [],
    - create_ts       : 1969-12-31 16:00:00
>

However,

  1. taskId is incorrect
  2. row_count is wrong
  3. id_ranges is wrong
  4. create_ts is wrong

Expected Behavior

list_bulk_insert_tasks should return correct values for the above fields. Also, why does it not return other fields as mentioned in the documentation: https://milvus.io/api-reference/pymilvus/v2.4.x/ORM/utility/list_bulk_insert_tasks.md

Steps To Reproduce

No response

Milvus Log

No response

Anything else?

No response

yanliang567 commented 1 day ago

a similar issue to https://github.com/milvus-io/milvus/issues/38051, please check

/assign @abd-770 /unassign

abd-770 commented 1 day ago

@yanliang567 We are currently using milvus 2.4.x, and this issue is for function list_bulk_insert_tasks returning invalid values for the returned fields.

yanliang567 commented 1 day ago

/assign @bigsheeper please help to take a look