ttengwang / PDVC

End-to-End Dense Video Captioning with Parallel Decoding (ICCV 2021)
MIT License
207 stars 23 forks source link

Results on YouCook2 varies with different Runs - Seed is same! #3

Closed anilbatra2185 closed 2 years ago

anilbatra2185 commented 3 years ago

Hi @ttengwang !

thanks for nice work on DVC!

I am able to run the code on YouCook2 with small configuration changes, however, I am getter different results if run the same code multiple time with same seed. Metric is SODA_c.

Method Validation
Run 1 4.171
Run 2 3.933
Run 3 4.322
Run 4 3.958
Average 4.096 ± 0.159

Please let me know your thoughts!

Regards Anil

ttengwang commented 2 years ago

Hi, sorry for the late reply! I also noticed that the training process has randomness, but I am not very sure about this question. A possible reason is the non-determinism in torch.nn.LSTM.