berkeleydeeprlcourse / homework_fall2019

187 stars 182 forks source link

Same code gets different results in Linux (Ubuntu) and Windows machine #8

Open KaiChen1998 opened 4 years ago

KaiChen1998 commented 4 years ago

Hi! I'm a student learning CS285 online. Thank you for your great and generous work!

When I'm doing homework1 and running the same code in two different machines, one Linux and one Windows, I got two different actor result (but the expert results are the same).

Aftrer looking into details, because of random seed, the data batches used to update parameters in every training iteration are exactly the same between two machines. Differences start to show up after running gradient descent even the first time.

So my question is just if the differences comes from different machine situations or there are some other reasons? What do you guys think?

archit120 commented 4 years ago

If you're using CuDNN that can choose non-deterministic methods to calculate the results of floating-point operations.