search

zilliztech / milvus-backup

Backup and restore tool for Milvus
Apache License 2.0
111 stars 38 forks source link

[Bug]: Can not backup DB with sparse vector field. #367

Open XinyuDu opened 5 days ago

XinyuDu commented 5 days ago

Current Behavior

Ubuntu 20.04 Milvus v2.4.1 Milvus-backup v0.4.15

Cannot backup the db with sparse vector field.

[2024/06/25 08:18:49.561 +00:00] [INFO] [core/backup_impl_restore_backup.go:721] ["execute bulk insert"] [db=default] [collection=_123a5fee_0ab7_4431_b0d3_f6807fba5ae5_47f641da_e708_47f0_b4a0_89abf1544bb0_recover] [partition=_default] [files="[backup/test_backup/binlogs/insert_log/450567692780131941/450567692780131942/450684820018465243/,]"] [endTime=450705079402496] [2024/06/25 08:18:49.570 +00:00] [INFO] [core/backup_impl_restore_backup.go:764] ["bulkinsert task state"] [id=450684820018637211] [state=0] [state="{\"ID\":0,\"State\":0,\"RowCount\":0,\"IDList\":null,\"Infos\":{\"failed_reason\":\"\",\"progress_percent\":\"0\"},\"CollectionID\":0,\"SegmentIDs\":null,\"CreateTs\":1719303529}"] [progress=0] [currentTimestamp=1719303529] [lastUpdateTime=1719303529] [2024/06/25 08:18:54.575 +00:00] [INFO] [core/backup_impl_restore_backup.go:764] ["bulkinsert task state"] [id=450684820018637211] [state=1] [state="{\"ID\":0,\"State\":1,\"RowCount\":0,\"IDList\":null,\"Infos\":{\"failed_reason\":\"Wrong rows type: invalid parameter[expected=SparseFloatVectorFieldData][actual=contents:\\\"\\\\004\\\\000\\\\000\\\\000\\\\000\\\\240\\\\022=\\\\005\\\\000\\\\000\\\\000\\\\000\\\\000\\\\022=\\\\006\\\\000\\\\000\\\\000\\\\000 \\\\022=\\\\020\\\\000\\\\000\\\\000\\\\000\\\\240\\\\021=\\\\036\\\\000\\\\000\\\\000\\\\000\\\\300\\\\021=%\\\\000\\\\000\\\\000\\\\000\\\\240\\\\022=+\\\\000\\\\000\\\\000\\\\000\\\\240\\\\022=J\\\\000\\\\000\\\\000\\\\000@\\\\022=\\\\204\\\\000\\\\000\\\\000\\\\000\\\\300\\\\022=\\\\233\\\\000\\\\000\\\\000\\\\000\\\\000\\\\020=\\\\325\\\\000\\\\000\\\\000\\\\000\\\\200\\\\022=\\\\010\\\\001\\\\000\\\\000\\\\000\\\\340\\\\201=k\\\\001\\\\000\\\\000\\\\000\\\\300f\\u003c\\\\321\\\\001\\\\000\\\\000\\\\000\\\\340\\\\021=\\\\326\\\\001\\\\000\\\\000\\\\000\\022=\\347\\001\\000\\000\\000\\3409\u003c\\002\\002\\000\\000\\000\\\\022=2\\\\002\\\\000\\\\000\\\\000 \\\\021=?\\\\002\\\\000\\\\000\\\\000\\\\340\\\\021=v\\\\002\\\\000\\\\000\\\\000@\\\\022={\\\\002\\\\000\\\\000\\\\000\

Expected Behavior

No response

Steps To Reproduce

No response

Environment

Ubuntu 20.04
Milvus v2.4.1
Milvus backup v0.4.15

Anything else?

No response

wayblink commented 3 days ago

@bigsheeper Please help see this? Is SparseFloatVector supported in Bulkinsert?

wayblink commented 3 days ago

@XinyuDu SparseFloatVector restore is only supported after 2.4.5