leokarlin / LaSO

LaSO: Label-Set Operations networks for multi-label few-shot learning - official implementation
BSD 3-Clause "New" or "Revised" License
86 stars 14 forks source link

About some details in the dataset split #20

Open iLing4ever opened 4 months ago

iLing4ever commented 4 months ago

Sorry to bother you, but I have some questions about the test set of your model in few-shot scenarios. I noticed that you keep a balanced distribution of labels when testing the few-shot performance, and the len of the test set is the same as COCO val2014. However, after selecting 16 test classes, just about 4k out of 40k images remained in the test phase, so I wonder whether it is valid to set the length of the test set the same as the whole COCO val2014 because it may reuse a lot of images, or I misunderstood your codes :) . I am looking forward to your kindly reply.