SilvioGiancola / TrackingNet-devkit

Development kit for TrackingNet
https://tracking-net.org/
170 stars 32 forks source link

Many annotations sticking out of FOV #23

Closed kumatheworld closed 3 years ago

kumatheworld commented 3 years ago

I found many ground truth boxes sticking out of the FOV.

For example, If you look at the first few lines of TRAIN_0/anno/-3TIfnTSM6c_2.txt, you can find negative values in the first column as below.

$ head TrackingNet/TRAIN_0/anno/-3TIfnTSM6c_2.txt
 1.00,102.00,245.00,174.00
 0.43,102.17,245.73,176.10
 4.16,95.37,237.87,172.33
-4.07,96.34,236.30,172.80
-11.54,92.42,248.73,183.07
-13.15,81.52,251.50,187.00
-12.02,82.62,248.80,187.20
-5.87,74.75,251.53,189.87
-2.97,72.83,250.13,191.27
-2.96,73.40,249.70,192.50

Is this intended?

kumatheworld commented 3 years ago

Sorry, I've just found the following lines in the paper.

Coarse annotations are provided by YT-BB at 1 fps. In order to increase the annotation density, we rely on a mixture of state-of-the-art trackers to fill in missing annotations. We claim that any tracker is reliable on a small time lapse of 1 second. We present in Section 4 the performance of state-of-the-art trackers on 1 second-long video segments from OTB100. As a result, we densely annotated the 30,132 videos using a weighted average between a forward and a backward pass using the DCF tracker [16]. By doing so, we provide a densely annotated training dataset for object tracking, along with code for automatically downloading videos from YouTube and extracting the annotated frames.

It seems like that the negative coordinates come from the tracker outputs.