search

pytorch / rl

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
https://pytorch.org/rl
MIT License
2.25k stars 297 forks source link

[Tests] Fix windows tests #2219

Closed vmoens closed 4 months ago

pytorch-bot[bot] commented 4 months ago

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2219

Note: Links to docs will display an error until the docs builds have been completed.

:heavy_exclamation_mark: 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

:x: 3 New Failures, 1 Unrelated Failure

As of commit 68c7749929e4440a7a89d241c29b433b7ecee502 with merge base c67ad59225520ff17f3a42d069771ff0dbd3fc25 (image):

NEW FAILURES - The following jobs have failed:

* [Habitat Tests on Linux / tests (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2219#25979947987) ([gh](https://github.com/pytorch/rl/actions/runs/9431369992/job/25979947987)) `RuntimeError: Command docker exec -t a60037724595b3e48efe6c44ccf7a589b7655cfbd443af8458def69c924a6a2e /exec failed with exit code 139` * [Unit-tests on Linux / tests-optdeps (3.10, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2219#25979949848) ([gh](https://github.com/pytorch/rl/actions/runs/9431369986/job/25979949848)) `RuntimeError: Command docker exec -t 965fa5b531ef1c4436d0a7f26cd28470f2619afcdcfc70c134f4d756d17a86de /exec failed with exit code 1` * [Unit-tests on Windows / unittests-cpu / windows-job](https://hud.pytorch.org/pr/pytorch/rl/2219#25979948009) ([gh](https://github.com/pytorch/rl/actions/runs/9431369990/job/25979948009)) `The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 128`

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

* [Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2219#25979949754) ([gh](https://github.com/pytorch/rl/actions/runs/9431369986/job/25979949754)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/c67ad59225520ff17f3a42d069771ff0dbd3fc25#25979927397)) `test/test_transforms.py::TestVecNorm::test_state_dict_vecnorm`

This comment was automatically generated by Dr. CI and updates every 15 minutes.

github-actions[bot] commented 4 months ago

$\color{#D29922}\textsf{\Large\⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results | Name | Max | Mean | Ops | Ops on Repo `HEAD` | Change | | ----------------------------------------------------------------------------------------- | --------- | --------- | --------------- | ------------------ | ----------------------------------- | | test_single | 0.1107s | 59.7425ms | 16.7385 Ops/s | 17.9391 Ops/s | $\textbf{\color{#d91a1a}-6.69\\%}$ | | test_sync | 30.6261ms | 30.1994ms | 33.1132 Ops/s | 31.6983 Ops/s | $\color{#35bf28}+4.46\\%$ | | test_async | 55.0746ms | 27.0190ms | 37.0110 Ops/s | 36.7764 Ops/s | $\color{#35bf28}+0.64\\%$ | | test_simple | 0.4454s | 0.3866s | 2.5869 Ops/s | 2.6191 Ops/s | $\color{#d91a1a}-1.23\\%$ | | test_transformed | 0.5324s | 0.5281s | 1.8934 Ops/s | 1.8654 Ops/s | $\color{#35bf28}+1.50\\%$ | | test_serial | 1.3045s | 1.2551s | 0.7968 Ops/s | 0.7723 Ops/s | $\color{#35bf28}+3.17\\%$ | | test_parallel | 1.1224s | 1.0606s | 0.9429 Ops/s | 0.9252 Ops/s | $\color{#35bf28}+1.90\\%$ | | test_step_mdp_speed[True-True-True-True-True] | 0.1460ms | 21.3608μs | 46.8146 KOps/s | 46.0315 KOps/s | $\color{#35bf28}+1.70\\%$ | | test_step_mdp_speed[True-True-True-True-False] | 44.4720μs | 13.1030μs | 76.3185 KOps/s | 75.3768 KOps/s | $\color{#35bf28}+1.25\\%$ | | test_step_mdp_speed[True-True-True-False-True] | 46.1460μs | 12.6481μs | 79.0634 KOps/s | 78.2732 KOps/s | $\color{#35bf28}+1.01\\%$ | | test_step_mdp_speed[True-True-True-False-False] | 51.2760μs | 7.7634μs | 128.8090 KOps/s | 129.7756 KOps/s | $\color{#d91a1a}-0.74\\%$ | | test_step_mdp_speed[True-True-False-True-True] | 54.4510μs | 22.6697μs | 44.1118 KOps/s | 42.9891 KOps/s | $\color{#35bf28}+2.61\\%$ | | test_step_mdp_speed[True-True-False-True-False] | 0.2827ms | 14.5752μs | 68.6097 KOps/s | 68.8385 KOps/s | $\color{#d91a1a}-0.33\\%$ | | test_step_mdp_speed[True-True-False-False-True] | 33.9630μs | 13.8768μs | 72.0627 KOps/s | 71.5416 KOps/s | $\color{#35bf28}+0.73\\%$ | | test_step_mdp_speed[True-True-False-False-False] | 29.3140μs | 8.9420μs | 111.8317 KOps/s | 111.1652 KOps/s | $\color{#35bf28}+0.60\\%$ | | test_step_mdp_speed[True-False-True-True-True] | 56.4450μs | 24.0275μs | 41.6190 KOps/s | 41.3389 KOps/s | $\color{#35bf28}+0.68\\%$ | | test_step_mdp_speed[True-False-True-True-False] | 43.3800μs | 15.6872μs | 63.7464 KOps/s | 63.2773 KOps/s | $\color{#35bf28}+0.74\\%$ | | test_step_mdp_speed[True-False-True-False-True] | 40.7960μs | 13.9295μs | 71.7903 KOps/s | 71.3912 KOps/s | $\color{#35bf28}+0.56\\%$ | | test_step_mdp_speed[True-False-True-False-False] | 46.1160μs | 8.9871μs | 111.2709 KOps/s | 111.3431 KOps/s | $\color{#d91a1a}-0.06\\%$ | | test_step_mdp_speed[True-False-False-True-True] | 54.9420μs | 24.9437μs | 40.0903 KOps/s | 39.3390 KOps/s | $\color{#35bf28}+1.91\\%$ | | test_step_mdp_speed[True-False-False-True-False] | 46.1560μs | 16.8263μs | 59.4308 KOps/s | 59.0664 KOps/s | $\color{#35bf28}+0.62\\%$ | | test_step_mdp_speed[True-False-False-False-True] | 56.1350μs | 14.8824μs | 67.1936 KOps/s | 65.9455 KOps/s | $\color{#35bf28}+1.89\\%$ | | test_step_mdp_speed[True-False-False-False-False] | 30.2360μs | 10.1552μs | 98.4716 KOps/s | 98.7988 KOps/s | $\color{#d91a1a}-0.33\\%$ | | test_step_mdp_speed[False-True-True-True-True] | 58.4590μs | 23.9910μs | 41.6823 KOps/s | 40.7848 KOps/s | $\color{#35bf28}+2.20\\%$ | | test_step_mdp_speed[False-True-True-True-False] | 50.8850μs | 15.6072μs | 64.0730 KOps/s | 63.1782 KOps/s | $\color{#35bf28}+1.42\\%$ | | test_step_mdp_speed[False-True-True-False-True] | 43.8620μs | 15.9917μs | 62.5325 KOps/s | 61.4285 KOps/s | $\color{#35bf28}+1.80\\%$ | | test_step_mdp_speed[False-True-True-False-False] | 32.5710μs | 10.1604μs | 98.4216 KOps/s | 97.9631 KOps/s | $\color{#35bf28}+0.47\\%$ | | test_step_mdp_speed[False-True-False-True-True] | 59.0900μs | 25.2774μs | 39.5610 KOps/s | 39.3284 KOps/s | $\color{#35bf28}+0.59\\%$ | | test_step_mdp_speed[False-True-False-True-False] | 40.0650μs | 16.8978μs | 59.1792 KOps/s | 58.8959 KOps/s | $\color{#35bf28}+0.48\\%$ | | test_step_mdp_speed[False-True-False-False-True] | 46.9970μs | 17.1989μs | 58.1434 KOps/s | 57.5851 KOps/s | $\color{#35bf28}+0.97\\%$ | | test_step_mdp_speed[False-True-False-False-False] | 34.6150μs | 11.4591μs | 87.2667 KOps/s | 88.0968 KOps/s | $\color{#d91a1a}-0.94\\%$ | | test_step_mdp_speed[False-False-True-True-True] | 62.1660μs | 26.5972μs | 37.5979 KOps/s | 37.1654 KOps/s | $\color{#35bf28}+1.16\\%$ | | test_step_mdp_speed[False-False-True-True-False] | 46.7170μs | 18.5562μs | 53.8902 KOps/s | 54.6812 KOps/s | $\color{#d91a1a}-1.45\\%$ | | test_step_mdp_speed[False-False-True-False-True] | 49.1010μs | 17.2886μs | 57.8416 KOps/s | 57.5479 KOps/s | $\color{#35bf28}+0.51\\%$ | | test_step_mdp_speed[False-False-True-False-False] | 33.6120μs | 11.3971μs | 87.7415 KOps/s | 87.4054 KOps/s | $\color{#35bf28}+0.38\\%$ | | test_step_mdp_speed[False-False-False-True-True] | 38.2010μs | 27.7415μs | 36.0470 KOps/s | 35.1241 KOps/s | $\color{#35bf28}+2.63\\%$ | | test_step_mdp_speed[False-False-False-True-False] | 42.4190μs | 19.2985μs | 51.8175 KOps/s | 51.5813 KOps/s | $\color{#35bf28}+0.46\\%$ | | test_step_mdp_speed[False-False-False-False-True] | 48.7110μs | 18.2138μs | 54.9034 KOps/s | 54.3308 KOps/s | $\color{#35bf28}+1.05\\%$ | | test_step_mdp_speed[False-False-False-False-False] | 39.8140μs | 12.4201μs | 80.5145 KOps/s | 80.5970 KOps/s | $\color{#d91a1a}-0.10\\%$ | | test_values[generalized_advantage_estimate-True-True] | 10.0460ms | 9.8223ms | 101.8088 Ops/s | 105.4378 Ops/s | $\color{#d91a1a}-3.44\\%$ | | test_values[vec_generalized_advantage_estimate-True-True] | 36.9982ms | 33.2762ms | 30.0515 Ops/s | 28.6250 Ops/s | $\color{#35bf28}+4.98\\%$ | | test_values[td0_return_estimate-False-False] | 0.2216ms | 0.1703ms | 5.8732 KOps/s | 5.9955 KOps/s | $\color{#d91a1a}-2.04\\%$ | | test_values[td1_return_estimate-False-False] | 27.6419ms | 24.2205ms | 41.2874 Ops/s | 42.6755 Ops/s | $\color{#d91a1a}-3.25\\%$ | | test_values[vec_td1_return_estimate-False-False] | 35.2230ms | 33.4096ms | 29.9315 Ops/s | 28.6191 Ops/s | $\color{#35bf28}+4.59\\%$ | | test_values[td_lambda_return_estimate-True-False] | 48.9215ms | 34.9771ms | 28.5901 Ops/s | 29.8783 Ops/s | $\color{#d91a1a}-4.31\\%$ | | test_values[vec_td_lambda_return_estimate-True-False] | 34.7582ms | 33.2948ms | 30.0348 Ops/s | 28.5875 Ops/s | $\textbf{\color{#35bf28}+5.06\\%}$ | | test_gae_speed[generalized_advantage_estimate-False-1-512] | 10.2135ms | 8.5400ms | 117.0964 Ops/s | 119.8998 Ops/s | $\color{#d91a1a}-2.34\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-True-1-512] | 2.1843ms | 1.9081ms | 524.0773 Ops/s | 494.8188 Ops/s | $\textbf{\color{#35bf28}+5.91\\%}$ | | test_gae_speed[vec_generalized_advantage_estimate-False-1-512] | 0.4324ms | 0.3520ms | 2.8412 KOps/s | 2.8474 KOps/s | $\color{#d91a1a}-0.22\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-True-32-512] | 42.9306ms | 42.1647ms | 23.7165 Ops/s | 21.7653 Ops/s | $\textbf{\color{#35bf28}+8.96\\%}$ | | test_gae_speed[vec_generalized_advantage_estimate-False-32-512] | 3.6477ms | 3.0317ms | 329.8484 Ops/s | 330.2540 Ops/s | $\color{#d91a1a}-0.12\\%$ | | test_dqn_speed | 1.7236ms | 1.3304ms | 751.6485 Ops/s | 741.2514 Ops/s | $\color{#35bf28}+1.40\\%$ | | test_ddpg_speed | 3.6839ms | 2.8452ms | 351.4709 Ops/s | 351.8005 Ops/s | $\color{#d91a1a}-0.09\\%$ | | test_sac_speed | 10.4870ms | 8.4268ms | 118.6684 Ops/s | 119.4845 Ops/s | $\color{#d91a1a}-0.68\\%$ | | test_redq_speed | 14.7880ms | 13.5808ms | 73.6331 Ops/s | 75.6756 Ops/s | $\color{#d91a1a}-2.70\\%$ | | test_redq_deprec_speed | 14.7720ms | 13.3822ms | 74.7261 Ops/s | 75.4910 Ops/s | $\color{#d91a1a}-1.01\\%$ | | test_td3_speed | 16.5001ms | 8.4138ms | 118.8523 Ops/s | 119.4590 Ops/s | $\color{#d91a1a}-0.51\\%$ | | test_cql_speed | 38.8952ms | 36.7503ms | 27.2107 Ops/s | 27.3458 Ops/s | $\color{#d91a1a}-0.49\\%$ | | test_a2c_speed | 8.5560ms | 7.5024ms | 133.2908 Ops/s | 133.9772 Ops/s | $\color{#d91a1a}-0.51\\%$ | | test_ppo_speed | 8.6587ms | 7.8128ms | 127.9950 Ops/s | 128.4697 Ops/s | $\color{#d91a1a}-0.37\\%$ | | test_reinforce_speed | 7.3569ms | 6.6922ms | 149.4280 Ops/s | 149.4343 Ops/s | $-0.00\\%$ | | test_iql_speed | 33.5420ms | 32.9467ms | 30.3521 Ops/s | 30.4179 Ops/s | $\color{#d91a1a}-0.22\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 5.2977ms | 3.5629ms | 280.6675 Ops/s | 284.8537 Ops/s | $\color{#d91a1a}-1.47\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.9910ms | 0.5017ms | 1.9934 KOps/s | 2.0015 KOps/s | $\color{#d91a1a}-0.41\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.6571ms | 0.4805ms | 2.0814 KOps/s | 2.1126 KOps/s | $\color{#d91a1a}-1.48\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 4.3679ms | 3.5700ms | 280.1142 Ops/s | 283.7130 Ops/s | $\color{#d91a1a}-1.27\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 1.0098ms | 0.4946ms | 2.0218 KOps/s | 2.0334 KOps/s | $\color{#d91a1a}-0.57\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.6489ms | 0.4745ms | 2.1074 KOps/s | 2.1251 KOps/s | $\color{#d91a1a}-0.83\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] | 2.3099ms | 1.7066ms | 585.9551 Ops/s | 590.5859 Ops/s | $\color{#d91a1a}-0.78\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] | 1.9595ms | 1.6143ms | 619.4818 Ops/s | 625.2784 Ops/s | $\color{#d91a1a}-0.93\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 5.5106ms | 3.6749ms | 272.1142 Ops/s | 273.7851 Ops/s | $\color{#d91a1a}-0.61\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 0.1049s | 0.7025ms | 1.4235 KOps/s | 1.4236 KOps/s | $-0.01\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 0.8178ms | 0.5913ms | 1.6912 KOps/s | 1.7086 KOps/s | $\color{#d91a1a}-1.02\\%$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 3.7723ms | 3.6036ms | 277.5012 Ops/s | 284.6088 Ops/s | $\color{#d91a1a}-2.50\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 1.0761ms | 0.5111ms | 1.9566 KOps/s | 1.9818 KOps/s | $\color{#d91a1a}-1.27\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.6132ms | 0.4878ms | 2.0499 KOps/s | 2.0992 KOps/s | $\color{#d91a1a}-2.35\\%$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 3.9901ms | 3.6673ms | 272.6802 Ops/s | 281.6926 Ops/s | $\color{#d91a1a}-3.20\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 0.7009ms | 0.5111ms | 1.9564 KOps/s | 2.0211 KOps/s | $\color{#d91a1a}-3.20\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 4.0334ms | 0.4921ms | 2.0322 KOps/s | 2.1127 KOps/s | $\color{#d91a1a}-3.81\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 4.4276ms | 3.8663ms | 258.6467 Ops/s | 276.1739 Ops/s | $\textbf{\color{#d91a1a}-6.35\\%}$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 1.2726ms | 0.6367ms | 1.5705 KOps/s | 1.6122 KOps/s | $\color{#d91a1a}-2.58\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 0.7604ms | 0.6052ms | 1.6523 KOps/s | 1.6862 KOps/s | $\color{#d91a1a}-2.01\\%$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] | 0.1249s | 6.1414ms | 162.8302 Ops/s | 127.8137 Ops/s | $\textbf{\color{#35bf28}+27.40\\%}$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] | 17.0297ms | 12.6218ms | 79.2280 Ops/s | 79.8858 Ops/s | $\color{#d91a1a}-0.82\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] | 1.5873ms | 1.0921ms | 915.6677 Ops/s | 963.8352 Ops/s | $\color{#d91a1a}-5.00\\%$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] | 0.1128s | 5.9728ms | 167.4254 Ops/s | 179.9377 Ops/s | $\textbf{\color{#d91a1a}-6.95\\%}$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] | 15.3123ms | 12.6539ms | 79.0269 Ops/s | 80.4345 Ops/s | $\color{#d91a1a}-1.75\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] | 3.8489ms | 1.1124ms | 898.9660 Ops/s | 962.6204 Ops/s | $\textbf{\color{#d91a1a}-6.61\\%}$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] | 0.1023s | 5.8270ms | 171.6163 Ops/s | 175.7321 Ops/s | $\color{#d91a1a}-2.34\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] | 0.1061s | 14.4925ms | 69.0012 Ops/s | 69.0845 Ops/s | $\color{#d91a1a}-0.12\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] | 3.6578ms | 1.2388ms | 807.2419 Ops/s | 839.0438 Ops/s | $\color{#d91a1a}-3.79\\%$ |
github-actions[bot] commented 4 months ago

$\color{#D29922}\textsf{\Large\⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}3$.

Expand to view detailed results | Name | Max | Mean | Ops | Ops on Repo `HEAD` | Change | | ----------------------------------------------------------------------------------------- | --------- | --------- | -------------- | ------------------ | ----------------------------------- | | test_single | 0.1213s | 0.1180s | 8.4752 Ops/s | 8.6000 Ops/s | $\color{#d91a1a}-1.45\\%$ | | test_sync | 0.1052s | 0.1029s | 9.7173 Ops/s | 9.5104 Ops/s | $\color{#35bf28}+2.17\\%$ | | test_async | 0.1946s | 94.8987ms | 10.5376 Ops/s | 10.1173 Ops/s | $\color{#35bf28}+4.15\\%$ | | test_single_pixels | 0.1288s | 0.1284s | 7.7909 Ops/s | 7.8961 Ops/s | $\color{#d91a1a}-1.33\\%$ | | test_sync_pixels | 84.4281ms | 81.2584ms | 12.3064 Ops/s | 12.3898 Ops/s | $\color{#d91a1a}-0.67\\%$ | | test_async_pixels | 0.1523s | 66.7713ms | 14.9765 Ops/s | 14.8123 Ops/s | $\color{#35bf28}+1.11\\%$ | | test_simple | 0.9160s | 0.8611s | 1.1613 Ops/s | 1.2487 Ops/s | $\textbf{\color{#d91a1a}-7.00\\%}$ | | test_transformed | 1.1384s | 1.0892s | 0.9181 Ops/s | 0.9311 Ops/s | $\color{#d91a1a}-1.39\\%$ | | test_serial | 2.5325s | 2.4789s | 0.4034 Ops/s | 0.3869 Ops/s | $\color{#35bf28}+4.26\\%$ | | test_parallel | 2.4332s | 2.3646s | 0.4229 Ops/s | 0.4170 Ops/s | $\color{#35bf28}+1.41\\%$ | | test_step_mdp_speed[True-True-True-True-True] | 77.0420μs | 33.6692μs | 29.7007 KOps/s | 29.3600 KOps/s | $\color{#35bf28}+1.16\\%$ | | test_step_mdp_speed[True-True-True-True-False] | 39.2310μs | 19.8660μs | 50.3372 KOps/s | 50.5980 KOps/s | $\color{#d91a1a}-0.52\\%$ | | test_step_mdp_speed[True-True-True-False-True] | 37.0710μs | 19.2228μs | 52.0214 KOps/s | 50.3730 KOps/s | $\color{#35bf28}+3.27\\%$ | | test_step_mdp_speed[True-True-True-False-False] | 46.1710μs | 11.2172μs | 89.1486 KOps/s | 87.3811 KOps/s | $\color{#35bf28}+2.02\\%$ | | test_step_mdp_speed[True-True-False-True-True] | 65.5110μs | 34.9009μs | 28.6525 KOps/s | 28.1690 KOps/s | $\color{#35bf28}+1.72\\%$ | | test_step_mdp_speed[True-True-False-True-False] | 40.8510μs | 21.7581μs | 45.9598 KOps/s | 45.6526 KOps/s | $\color{#35bf28}+0.67\\%$ | | test_step_mdp_speed[True-True-False-False-True] | 66.4510μs | 20.6397μs | 48.4504 KOps/s | 47.4144 KOps/s | $\color{#35bf28}+2.18\\%$ | | test_step_mdp_speed[True-True-False-False-False] | 37.3410μs | 13.1880μs | 75.8264 KOps/s | 74.8370 KOps/s | $\color{#35bf28}+1.32\\%$ | | test_step_mdp_speed[True-False-True-True-True] | 62.8720μs | 37.5427μs | 26.6363 KOps/s | 26.7867 KOps/s | $\color{#d91a1a}-0.56\\%$ | | test_step_mdp_speed[True-False-True-True-False] | 40.3010μs | 23.4601μs | 42.6255 KOps/s | 42.2680 KOps/s | $\color{#35bf28}+0.85\\%$ | | test_step_mdp_speed[True-False-True-False-True] | 45.6310μs | 20.5232μs | 48.7254 KOps/s | 47.3106 KOps/s | $\color{#35bf28}+2.99\\%$ | | test_step_mdp_speed[True-False-True-False-False] | 39.1310μs | 13.2394μs | 75.5322 KOps/s | 75.0660 KOps/s | $\color{#35bf28}+0.62\\%$ | | test_step_mdp_speed[True-False-False-True-True] | 63.5520μs | 38.6615μs | 25.8655 KOps/s | 25.3076 KOps/s | $\color{#35bf28}+2.20\\%$ | | test_step_mdp_speed[True-False-False-True-False] | 58.5910μs | 25.7142μs | 38.8890 KOps/s | 39.2042 KOps/s | $\color{#d91a1a}-0.80\\%$ | | test_step_mdp_speed[True-False-False-False-True] | 44.5810μs | 22.5603μs | 44.3257 KOps/s | 43.5816 KOps/s | $\color{#35bf28}+1.71\\%$ | | test_step_mdp_speed[True-False-False-False-False] | 35.1610μs | 15.1978μs | 65.7988 KOps/s | 65.9396 KOps/s | $\color{#d91a1a}-0.21\\%$ | | test_step_mdp_speed[False-True-True-True-True] | 81.0220μs | 37.2596μs | 26.8387 KOps/s | 26.4834 KOps/s | $\color{#35bf28}+1.34\\%$ | | test_step_mdp_speed[False-True-True-True-False] | 53.0320μs | 23.3283μs | 42.8663 KOps/s | 41.7859 KOps/s | $\color{#35bf28}+2.59\\%$ | | test_step_mdp_speed[False-True-True-False-True] | 46.7210μs | 24.0522μs | 41.5762 KOps/s | 39.5755 KOps/s | $\textbf{\color{#35bf28}+5.06\\%}$ | | test_step_mdp_speed[False-True-True-False-False] | 34.5600μs | 15.1976μs | 65.7999 KOps/s | 66.3613 KOps/s | $\color{#d91a1a}-0.85\\%$ | | test_step_mdp_speed[False-True-False-True-True] | 59.0020μs | 38.9929μs | 25.6457 KOps/s | 25.8671 KOps/s | $\color{#d91a1a}-0.86\\%$ | | test_step_mdp_speed[False-True-False-True-False] | 52.8510μs | 25.5597μs | 39.1241 KOps/s | 38.4557 KOps/s | $\color{#35bf28}+1.74\\%$ | | test_step_mdp_speed[False-True-False-False-True] | 53.9920μs | 26.3332μs | 37.9749 KOps/s | 36.2122 KOps/s | $\color{#35bf28}+4.87\\%$ | | test_step_mdp_speed[False-True-False-False-False] | 50.8110μs | 16.9936μs | 58.8457 KOps/s | 59.2188 KOps/s | $\color{#d91a1a}-0.63\\%$ | | test_step_mdp_speed[False-False-True-True-True] | 62.7110μs | 40.6547μs | 24.5974 KOps/s | 24.3076 KOps/s | $\color{#35bf28}+1.19\\%$ | | test_step_mdp_speed[False-False-True-True-False] | 51.7510μs | 27.1236μs | 36.8683 KOps/s | 36.1885 KOps/s | $\color{#35bf28}+1.88\\%$ | | test_step_mdp_speed[False-False-True-False-True] | 51.1610μs | 26.1556μs | 38.2327 KOps/s | 37.4492 KOps/s | $\color{#35bf28}+2.09\\%$ | | test_step_mdp_speed[False-False-True-False-False] | 42.3310μs | 17.0746μs | 58.5665 KOps/s | 58.6538 KOps/s | $\color{#d91a1a}-0.15\\%$ | | test_step_mdp_speed[False-False-False-True-True] | 58.0810μs | 42.7380μs | 23.3984 KOps/s | 22.9350 KOps/s | $\color{#35bf28}+2.02\\%$ | | test_step_mdp_speed[False-False-False-True-False] | 53.8110μs | 29.4003μs | 34.0133 KOps/s | 33.2874 KOps/s | $\color{#35bf28}+2.18\\%$ | | test_step_mdp_speed[False-False-False-False-True] | 50.2910μs | 27.6188μs | 36.2072 KOps/s | 34.8582 KOps/s | $\color{#35bf28}+3.87\\%$ | | test_step_mdp_speed[False-False-False-False-False] | 43.8010μs | 18.6696μs | 53.5630 KOps/s | 53.2102 KOps/s | $\color{#35bf28}+0.66\\%$ | | test_values[generalized_advantage_estimate-True-True] | 25.4746ms | 24.3376ms | 41.0886 Ops/s | 41.9035 Ops/s | $\color{#d91a1a}-1.94\\%$ | | test_values[vec_generalized_advantage_estimate-True-True] | 90.5844ms | 2.7152ms | 368.3017 Ops/s | 350.8309 Ops/s | $\color{#35bf28}+4.98\\%$ | | test_values[td0_return_estimate-False-False] | 0.1014ms | 66.1353μs | 15.1205 KOps/s | 15.3999 KOps/s | $\color{#d91a1a}-1.81\\%$ | | test_values[td1_return_estimate-False-False] | 57.2753ms | 55.7489ms | 17.9376 Ops/s | 18.2270 Ops/s | $\color{#d91a1a}-1.59\\%$ | | test_values[vec_td1_return_estimate-False-False] | 1.3772ms | 1.0887ms | 918.5676 Ops/s | 925.8669 Ops/s | $\color{#d91a1a}-0.79\\%$ | | test_values[td_lambda_return_estimate-True-False] | 91.0896ms | 89.0405ms | 11.2308 Ops/s | 11.6429 Ops/s | $\color{#d91a1a}-3.54\\%$ | | test_values[vec_td_lambda_return_estimate-True-False] | 1.3231ms | 1.0873ms | 919.7272 Ops/s | 929.1257 Ops/s | $\color{#d91a1a}-1.01\\%$ | | test_gae_speed[generalized_advantage_estimate-False-1-512] | 25.9712ms | 25.6026ms | 39.0586 Ops/s | 40.7081 Ops/s | $\color{#d91a1a}-4.05\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-True-1-512] | 0.9658ms | 0.7279ms | 1.3738 KOps/s | 1.4012 KOps/s | $\color{#d91a1a}-1.96\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-False-1-512] | 0.7598ms | 0.6757ms | 1.4798 KOps/s | 1.4594 KOps/s | $\color{#35bf28}+1.40\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-True-32-512] | 1.5507ms | 1.4772ms | 676.9635 Ops/s | 684.0015 Ops/s | $\color{#d91a1a}-1.03\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-False-32-512] | 0.7632ms | 0.7033ms | 1.4219 KOps/s | 1.4694 KOps/s | $\color{#d91a1a}-3.23\\%$ | | test_dqn_speed | 1.6451ms | 1.4467ms | 691.2510 Ops/s | 687.4928 Ops/s | $\color{#35bf28}+0.55\\%$ | | test_ddpg_speed | 3.3112ms | 2.9458ms | 339.4631 Ops/s | 331.6095 Ops/s | $\color{#35bf28}+2.37\\%$ | | test_sac_speed | 8.6729ms | 8.2857ms | 120.6902 Ops/s | 118.1299 Ops/s | $\color{#35bf28}+2.17\\%$ | | test_redq_speed | 12.4163ms | 10.5881ms | 94.4460 Ops/s | 85.8655 Ops/s | $\textbf{\color{#35bf28}+9.99\\%}$ | | test_redq_deprec_speed | 12.0553ms | 11.1294ms | 89.8524 Ops/s | 87.5738 Ops/s | $\color{#35bf28}+2.60\\%$ | | test_td3_speed | 17.1992ms | 8.3193ms | 120.2023 Ops/s | 118.9881 Ops/s | $\color{#35bf28}+1.02\\%$ | | test_cql_speed | 26.5929ms | 25.7006ms | 38.9096 Ops/s | 39.1800 Ops/s | $\color{#d91a1a}-0.69\\%$ | | test_a2c_speed | 5.7530ms | 5.4970ms | 181.9175 Ops/s | 175.5883 Ops/s | $\color{#35bf28}+3.60\\%$ | | test_ppo_speed | 6.1567ms | 5.9439ms | 168.2406 Ops/s | 167.7770 Ops/s | $\color{#35bf28}+0.28\\%$ | | test_reinforce_speed | 4.8395ms | 4.5918ms | 217.7814 Ops/s | 215.4031 Ops/s | $\color{#35bf28}+1.10\\%$ | | test_iql_speed | 20.0237ms | 19.3665ms | 51.6355 Ops/s | 50.5464 Ops/s | $\color{#35bf28}+2.15\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 4.8329ms | 4.6367ms | 215.6701 Ops/s | 214.8833 Ops/s | $\color{#35bf28}+0.37\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 1.3467ms | 0.5921ms | 1.6888 KOps/s | 1.4604 KOps/s | $\textbf{\color{#35bf28}+15.64\\%}$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.7598ms | 0.5703ms | 1.7536 KOps/s | 1.7269 KOps/s | $\color{#35bf28}+1.54\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 4.8429ms | 4.6136ms | 216.7489 Ops/s | 216.8918 Ops/s | $\color{#d91a1a}-0.07\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 1.2744ms | 0.5897ms | 1.6958 KOps/s | 1.6740 KOps/s | $\color{#35bf28}+1.30\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.8671ms | 0.5703ms | 1.7535 KOps/s | 1.7534 KOps/s | $+0.00\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] | 4.7158ms | 2.0707ms | 482.9337 Ops/s | 477.9613 Ops/s | $\color{#35bf28}+1.04\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] | 2.1559ms | 1.9483ms | 513.2557 Ops/s | 500.6014 Ops/s | $\color{#35bf28}+2.53\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 4.8792ms | 4.7499ms | 210.5296 Ops/s | 208.8333 Ops/s | $\color{#35bf28}+0.81\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 0.9021ms | 0.7176ms | 1.3935 KOps/s | 1.3730 KOps/s | $\color{#35bf28}+1.49\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 70.0841ms | 0.7569ms | 1.3212 KOps/s | 1.4014 KOps/s | $\textbf{\color{#d91a1a}-5.72\\%}$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 4.8152ms | 4.6161ms | 216.6316 Ops/s | 215.0312 Ops/s | $\color{#35bf28}+0.74\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.7007ms | 0.5883ms | 1.6998 KOps/s | 1.6574 KOps/s | $\color{#35bf28}+2.56\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.7238ms | 0.5719ms | 1.7486 KOps/s | 1.7354 KOps/s | $\color{#35bf28}+0.76\\%$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 4.8638ms | 4.5901ms | 217.8625 Ops/s | 214.6570 Ops/s | $\color{#35bf28}+1.49\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 1.4882ms | 0.5829ms | 1.7154 KOps/s | 1.6820 KOps/s | $\color{#35bf28}+1.99\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.7067ms | 0.5671ms | 1.7633 KOps/s | 1.7592 KOps/s | $\color{#35bf28}+0.23\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 4.9214ms | 4.7509ms | 210.4864 Ops/s | 209.0286 Ops/s | $\color{#35bf28}+0.70\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 0.8212ms | 0.7170ms | 1.3947 KOps/s | 1.3823 KOps/s | $\color{#35bf28}+0.90\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 0.8683ms | 0.6956ms | 1.4376 KOps/s | 1.4409 KOps/s | $\color{#d91a1a}-0.23\\%$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] | 0.1270s | 7.3463ms | 136.1239 Ops/s | 100.8296 Ops/s | $\textbf{\color{#35bf28}+35.00\\%}$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] | 17.8555ms | 15.6884ms | 63.7415 Ops/s | 61.9567 Ops/s | $\color{#35bf28}+2.88\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] | 2.5737ms | 1.3611ms | 734.7198 Ops/s | 754.3323 Ops/s | $\color{#d91a1a}-2.60\\%$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] | 0.1207s | 7.2680ms | 137.5903 Ops/s | 137.5382 Ops/s | $\color{#35bf28}+0.04\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] | 0.1307s | 18.0663ms | 55.3516 Ops/s | 62.3633 Ops/s | $\textbf{\color{#d91a1a}-11.24\\%}$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] | 2.4918ms | 1.2883ms | 776.2280 Ops/s | 754.0551 Ops/s | $\color{#35bf28}+2.94\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] | 0.1170s | 7.2995ms | 136.9950 Ops/s | 135.8878 Ops/s | $\color{#35bf28}+0.81\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] | 18.6117ms | 15.8583ms | 63.0583 Ops/s | 62.1396 Ops/s | $\color{#35bf28}+1.48\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] | 2.6642ms | 1.4617ms | 684.1358 Ops/s | 688.1530 Ops/s | $\color{#d91a1a}-0.58\\%$ |