Deterministic mode is not set on remote worker

ray-project / ray_lightning

Pytorch Lightning Distributed Accelerators using Ray

Apache License 2.0

211 stars 34 forks source link

Open MarkusSpanring opened 2 years ago

MarkusSpanring commented 2 years ago

Fix related to #213

This PR should also fix an unreachable code segment introduced in my previous PR #208

MarkusSpanring commented 2 years ago

@JiahaoYao if you have time, could you check if _init_deterministic(True) is sufficient to replicate Trainer(deterministic=True) on all workers?