Results on YouCook2 varies with different Runs - Seed is same!

ttengwang / PDVC

End-to-End Dense Video Captioning with Parallel Decoding (ICCV 2021)

MIT License

207 stars 23 forks source link

Results on YouCook2 varies with different Runs - Seed is same! #3

Closed anilbatra2185 closed 2 years ago

anilbatra2185 commented 3 years ago

Hi @ttengwang !

thanks for nice work on DVC!

I am able to run the code on YouCook2 with small configuration changes, however, I am getter different results if run the same code multiple time with same seed. Metric is SODA_c.

Method	Validation
Run 1	4.171
Run 2	3.933
Run 3	4.322
Run 4	3.958
Average	4.096 ± 0.159

Please let me know your thoughts!

Regards Anil

ttengwang commented 2 years ago

Hi, sorry for the late reply! I also noticed that the training process has randomness, but I am not very sure about this question. A possible reason is the non-determinism in torch.nn.LSTM.