OrderOption.QUASI_RANDOM seems not to be deterministic given seed

libffcv / ffcv

FFCV: Fast Forward Computer Vision (and other ML workloads!)

https://ffcv.io

Apache License 2.0

2.82k stars 178 forks source link

OrderOption.QUASI_RANDOM seems not to be deterministic given seed #140

Closed dpaleka closed 2 years ago

dpaleka commented 2 years ago

Here is the modified ffcv-imagenet demo, on Imagenette, with two loaders on the same file initialized with the same parameters.

https://gist.github.com/dpaleka/97101b99dcb055aa6526fe37dbe6897d

The two loaders produce (slightly) different first batches.

GuillaumeLeclerc commented 2 years ago

Thank you for the report. This is not expected and I will take a look.

GuillaumeLeclerc commented 2 years ago

Hello @dpaleka I don't have this dataset. Is there a way you could provide an example that uses randomly generated data so that I can run it on my local machine without downloading anything ?

dpaleka commented 2 years ago

Root cause is very likely #163.