milvus-io / milvus-tools

A data migration tool for Milvus.
Apache License 2.0
68 stars 21 forks source link

Error using milvusdm #12

Closed LeeREVO closed 3 years ago

LeeREVO commented 3 years ago

when I execute milvusdm --yaml M2H.yaml I got:

2021-04-23 14:28:21,740 | INFO | milvus_to_hdf5.py | read_milvus_data | 50 | Ready to read all data of collection: ann_1m_sq8/partitions: [None] 0%| | 0/1 [00:00<?, ?it/s] 2021-04-23 14:28:21,908 | ERROR | milvus_to_hdf5.py | read_milvus_data | 56 | Error with: cannot reshape array of size 307200000 into shape (600000,16)

Is there any wrong with the data volume?

shiyu22 commented 3 years ago

I think you have the same issue with https://github.com/milvus-io/milvus-tools/issues/9.

LeeREVO commented 3 years ago

Yep, but that issue don't have any follow up or solution. Is there a better way other than modify the source and debug by myself?

shiyu22 commented 3 years ago

Could you please send me one segment file?