Closed bmoore20 closed 3 years ago
https://discuss.pytorch.org/t/how-to-set-the-same-random-seed-for-all-workers/92253/7
https://discuss.pytorch.org/t/does-pytorch-change-its-internal-seed-during-training/46505/6
https://www.programcreek.com/python/example/101148/torch.initial_seed
https://pytorch.org/docs/stable/generated/torch.initial_seed.html
Need to capture seeds in log so we can keep track of seeds and refer back to seeds that produced good outcomes.
Read about the Lottery Ticket Hypothesis: https://arxiv.org/abs/1803.03635