search

NUST-Machine-Intelligence-Laboratory / HFAN

31 stars 3 forks source link

How to evaluate on YouTube-Objects and Long-Videos datasets? #4

Open xyzskysea opened 2 years ago

xyzskysea commented 2 years ago

How to evaluate on YouTube-Objects and Long-Videos datasets? and where to download corresponding dataset with groundtruth? could you provide the results of these two datasets?

CODE4UVOS commented 2 years ago

Please refer to our related project.

xyzskysea commented 2 years ago

i follow [The YouTube-Objects dataset can be downloaded from here and annotation can be found here.].

Do you use the dataset release v2.3? if possible, could you please provide the clean-up dataset and annotations directly? goole drive or baidu?

CODE4UVOS commented 2 years ago

The YouTube-Objects dataset has already been uploaded to GoogleDirve.

xyzskysea commented 2 years ago

In the YO2SEG, the Annotations are the groundtruth, mask folder is the results. Right?

CODE4UVOS commented 2 years ago

'Annotation' is GT (0,255), 'mask' is also GT (0,1).

xyzskysea commented 2 years ago

ok. i tried that. but found that the size of aeroplane0001/00001.png is 854x480. but in the results of HGPU it is 480x360. And i also found that in the AGNN results, the size is also 480x360. So which is the correct images and groundtruth? it's weird!

CODE4UVOS commented 2 years ago

They are both correct. '480x360' is the original size and '854x480' is after we resized it.

xyzskysea commented 2 years ago

but when i tried to use PyDavis16EvalToolbox to evaluate. it mentions that the size is not consistent. so how can i do it to reproduce the result in your paper?

CODE4UVOS commented 2 years ago

The validation tool library is available at davis-matlab.

chengguanjun commented 1 year ago

@xyzskysea Could you test on YouTube-Objects dataset to achieve the results in the paper?

qian507 commented 1 year ago

The YouTube-Objects dataset has already been uploaded to GoogleDirve.

Why does the YouTube-VOS data only contain val, but not train?