David0tt / DeepGTAV

A system to easily extract ground truth training data for different machine learning tasks from GTAV
GNU General Public License v3.0
89 stars 9 forks source link

mapping category id to class name seadronesee #6

Closed fabiopoiesi closed 2 years ago

fabiopoiesi commented 2 years ago

What is the mapping between category id and the class name? I am using the same one as that of Seadronesee (real) but it seems not working.

This is the one taken from Seadronesee:

Screenshot from 2022-05-23 11-40-29

Thanks

C-der-Baum commented 2 years ago

If I remember correctly, the mapping is as follows:

{"swimmer": 0, "floater": 1, "swimmer on boat": 2, "floater on boat": 3, "boat":4}

I'll add it to the readme.

fabiopoiesi commented 2 years ago

lifejacket?

C-der-Baum commented 2 years ago

There is no life jacket class (and no images containing just life jackets) in the synthetic version. In the paper (leveraging synthetic...), we still considered the class "life jacket" when evaluating on SeaDronesSee. However, it is very much underrepresented in the data set which is why standard object detectors fail on this class, yielding almost 0 AP (as can be seen in the SeaDronesSee paper). Therefore, it does not hurt in our Sim2real experiments to just ignore that class during training entirely.

fabiopoiesi commented 2 years ago

Thanks!