search

uzh-rpg / ess

Repository relating to "ESS: Learning Event-based Semantic Segmentation from Still Images" (ECCV, 2022).
GNU General Public License v3.0
70 stars 12 forks source link

Supervised only with events #14

Closed SchuckLee closed 4 months ago

SchuckLee commented 4 months ago

Hello, I would like to know how to set up supervised learning on ess using only events? I have set train_on_event_labels: True and model_name: 'ess_supervised', but I still use frame for training...

MessikommerNico commented 4 months ago

Hi, If you set the model_name == 'ess_supervised', it uses ESSSupervisedModel. This module should not use any frames for the training, see https://github.com/uzh-rpg/ess/blob/46bf1eed677d869c4733c89d2284e43ea27f97bd/training/ess_supervised_trainer.py#L111. How do you notice that it still uses frames?

SchuckLee commented 4 months ago

While running the code, I noticed that the Cityscapes dataset needs to be loaded, and Line 36 in settings_DDD17.yaml:https://github.com/uzh-rpg/ess/blob/46bf1eed677d869c4733c89d2284e43ea27f97bd/config/settings_DDD17.yaml#L36 train_on_event_labels: False # True for ESS supervised (events labels + frames labels), False for ESS UDA , which was confusing to me. Now it's resolved. Thank you for your reply!