uzh-rpg / ess

Repository relating to "ESS: Learning Event-based Semantic Segmentation from Still Images" (ECCV, 2022).
GNU General Public License v3.0
68 stars 12 forks source link

Testing code #2

Closed XiaRho closed 2 years ago

XiaRho commented 2 years ago

Hi, after downloading the pre-trained weights, how to test your models to generate the semantic segmentation results and get the MIoU index?

SunZNing commented 2 years ago

Hi, Please look at the newly added instructions for testing pre-trained models in the readme.

XiaRho commented 2 years ago

Thank you very much. One more question, when I try to reproduce the results (events+frames MIoU=53.29) on DSEC-Semantic in the supervised setting. I have already set the train_on_event_labels to True in settings_DSEC.yaml. However, the final MIoU is about 51.5. This seems to be the results of just using event labels. Could you also provide the pre-trained weights (events+frames MIoU=53.29) on DSEC-Semantic in the supervised setting? image

ShristiDasBiswas commented 2 years ago

Thank you very much. One more question, when I try to reproduce the results (events+frames MIoU=53.29) on DSEC-Semantic in the supervised setting. I have already set the train_on_event_labels to True in settings_DSEC.yaml. However, the final MIoU is about 51.5. This seems to be the results of just using event labels. Could you also provide the pre-trained weights (events+frames MIoU=53.29) on DSEC-Semantic in the supervised setting? image

Hi, what are the total trainable parameters that ESS uses? I am unable to generate to number.

XiaRho commented 2 years ago

Thank you very much. One more question, when I try to reproduce the results (events+frames MIoU=53.29) on DSEC-Semantic in the supervised setting. I have already set the train_on_event_labels to True in settings_DSEC.yaml. However, the final MIoU is about 51.5. This seems to be the results of just using event labels. Could you also provide the pre-trained weights (events+frames MIoU=53.29) on DSEC-Semantic in the supervised setting? image

Hi, what are the total trainable parameters that ESS uses? I am unable to generate to number.

I only set the model_name to ess_supervised (line 30), train_on_event_labels to True (line 35) in the setting_DSEC.yaml, and add this code self.use_task_a = True to the setting.py. I get the E2VID_lightweight from https://github.com/uzh-rpg/rpg_e2vid.

ldkong1205 commented 2 years ago

Hi @XiaRho, how much GPU memory is needed to run the experiment? What type of machines are you using? Thanks!

XiaRho commented 2 years ago

Hi @XiaRho, how much GPU memory is needed to run the experiment? What type of machines are you using? Thanks!

About 8000MB memory is need. l use the Tesla V100-SXM2-16GB.

ldkong1205 commented 2 years ago

Hi @XiaRho, how much GPU memory is needed to run the experiment? What type of machines are you using? Thanks!

About 8000MB memory is need. l use the Tesla V100-SXM2-16GB.

Thank you for your information!

MessikommerNico commented 2 years ago

Thank you very much. One more question, when I try to reproduce the results (events+frames MIoU=53.29) on DSEC-Semantic in the supervised setting. I have already set the train_on_event_labels to True in settings_DSEC.yaml. However, the final MIoU is about 51.5. This seems to be the results of just using event labels. Could you also provide the pre-trained weights (events+frames MIoU=53.29) on DSEC-Semantic in the supervised setting? image

Hi We added the links for the pre-trained weights obtained in the supervised settings to the Google form.

XiaRho commented 2 years ago

Thank you very much. One more question, when I try to reproduce the results (events+frames MIoU=53.29) on DSEC-Semantic in the supervised setting. I have already set the train_on_event_labels to True in settings_DSEC.yaml. However, the final MIoU is about 51.5. This seems to be the results of just using event labels. Could you also provide the pre-trained weights (events+frames MIoU=53.29) on DSEC-Semantic in the supervised setting? image

Hi We added the links for the pre-trained weights obtained in the supervised settings to the Google form.

Thank you very much!

SchuckLee commented 3 months ago

Hello, I would like to know how to set up supervised learning on ess using only events? I have set train_on_event_labels: True and model_name: 'ess_supervised', but I still use frame for training...Thanks a lot!