search

drckf / paysage

Unsupervised learning and generative models in python/pytorch.
Other
119 stars 25 forks source link

Trace sources of non-determinism #72

Closed d-rams closed 7 years ago

d-rams commented 7 years ago

We are seeing non-determinism in training in spite of the deterministic seeds in the code. We need to figure out what the source is (versions of libraries, etc.)

d-rams commented 7 years ago

@jrwalsh1 realized that there are small, but not-necessarily insignificant floating-point errors which can accumulate in the calculations.