zilliztech / milvus-migration

14 stars 2 forks source link

[Bug]: Where to add partition tag? #84

Closed uniyushu closed 3 months ago

uniyushu commented 3 months ago

Current Behavior

In Milvus-migration/testfiles/milvus1x/test1w/meta.json, I can't find the partition tag, but my data has a partition tag, how do I add this tag in meta.json?

{
    "collections": [
        {
            "collection": "test1w",
            "metric": 1,
            "rows": 10000,
            "dim": 256,
            "segments": [
                {
                    "collection": "test1w",
                    "segment": "1678354366132931000",
                    "dim": 256,
                    "rows": 10000,
                    "fileSize": 10320000
                }
            ]
        }
    ],
    "rows": 10000
}
{
    "collections": [
        {
            "collection": "test1w",
            "metric": 1,
            "rows": 10000,
            "dim": 256,
            "partitions": "total",    #
            "partition_tag": "total", # 
            "tag": "total",  # 
            "partition": "total",   # which name is the right answer
            "segments": [
                {
                    "collection": "test1w",
                    "segment": "1678354366132931000",
                    "dim": 256,
                    "rows": 10000,
                    "fileSize": 10320000
                }
            ]
        }
    ],
    "rows": 10000
}

Is partition tag supported?

Expected Behavior

transfer milvus1x to milvus2x

Steps To Reproduce

No response

Environment

No response

Anything else?

No response

xiaofan-luan commented 3 months ago

the API style of partition is very different. https://milvus.io/docs/manage-partitions.md

and partition search https://milvus.io/docs/single-vector-search.md#Partition-search

uniyushu commented 3 months ago

the API style of partition is very different. https://milvus.io/docs/manage-partitions.md

and partition search https://milvus.io/docs/single-vector-search.md#Partition-search

meta.json This example without partition tag, please provide one with a partition tag.

Thomas-HuWei commented 3 months ago

@uniyushu hello,I've konwn. Sorry that this tool not support partition now. And I'm learning about that the different partition mechanism between milvus1.x and milvus2.x. And it's still need some times to develop the support of partition.