Closed erwincoumans closed 9 months ago
oh, oh. :)
Btw you have pretty strange jumps up to 2m frames. On my computer it is much more stable:
fps step: 1246295.3 fps step and policy inference: 819567.2 fps total: 541351.9 epoch: 997/1000
fps step: 1241129.5 fps step and policy inference: 825741.9 fps total: 541277.2 epoch: 998/1000
fps step: 1226498.4 fps step and policy inference: 817077.4 fps total: 540681.0 epoch: 999/1000
fps step: 1250775.4 fps step and policy inference: 824889.4 fps total: 542131.3 epoch: 1000/1000
saving next best rewards: [7628.9634]
=> saving checkpoint 'runs/Ant_brax/nn/Ant_brax.pth'
Ill apply fix a little bit later. Will add line step_time = max(step_time, 0.00001)
@ViktorM did you fix it? :)
Running
trains so fast that step_time becomes 0.0 and then leads to a crash in two different places: