search

pytorch / rl

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
https://pytorch.org/rl
MIT License
2.19k stars 289 forks source link

[CI] Windows build fix #2335

Closed vmoens closed 1 month ago

pytorch-bot[bot] commented 1 month ago

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2335

Note: Links to docs will display an error until the docs builds have been completed.

:x: 1 New Failure, 1 Unrelated Failure

As of commit ae32ecc23fd33428fa6878dac523ffb97e276d40 with merge base 8fb55ef99e1d12a83d05bd1a73ddac439d104e9b (image):

NEW FAILURE - The following job has failed:

* [Habitat Tests on Linux / tests (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2335#28074139488) ([gh](https://github.com/pytorch/rl/actions/runs/10152537442/job/28074139488)) `RuntimeError: Command docker exec -t 76e156a535ddcd6652076ba245a8a9ec88ac45b559da9a5c0c16564f6aa01045 /exec failed with exit code 139`

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

* [Unit-tests on Windows / unittests-cpu / windows-job](https://hud.pytorch.org/pr/pytorch/rl/2335#28074147024) ([gh](https://github.com/pytorch/rl/actions/runs/10152537425/job/28074147024)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/8fb55ef99e1d12a83d05bd1a73ddac439d104e9b#28067202359)) `test/test_transforms.py::TestActionDiscretizer::test_trans_parallel_env_check[False]`

This comment was automatically generated by Dr. CI and updates every 15 minutes.

github-actions[bot] commented 1 month ago

$\color{#D29922}\textsf{\Large\⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}20$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results | Name | Max | Mean | Ops | Ops on Repo `HEAD` | Change | | ----------------------------------------------------------------------------------------- | --------- | --------- | --------------- | ------------------ | ----------------------------------- | | test_single | 61.3388ms | 60.6242ms | 16.4951 Ops/s | 17.1716 Ops/s | $\color{#d91a1a}-3.94\\%$ | | test_sync | 47.4121ms | 33.9449ms | 29.4595 Ops/s | 30.7818 Ops/s | $\color{#d91a1a}-4.30\\%$ | | test_async | 60.7238ms | 31.0379ms | 32.2186 Ops/s | 32.4720 Ops/s | $\color{#d91a1a}-0.78\\%$ | | test_simple | 0.4953s | 0.4187s | 2.3882 Ops/s | 2.5101 Ops/s | $\color{#d91a1a}-4.86\\%$ | | test_transformed | 0.6492s | 0.5859s | 1.7069 Ops/s | 1.7120 Ops/s | $\color{#d91a1a}-0.30\\%$ | | test_serial | 1.3298s | 1.2631s | 0.7917 Ops/s | 0.7925 Ops/s | $\color{#d91a1a}-0.09\\%$ | | test_parallel | 1.2088s | 1.1134s | 0.8981 Ops/s | 0.8922 Ops/s | $\color{#35bf28}+0.66\\%$ | | test_step_mdp_speed[True-True-True-True-True] | 0.1671ms | 24.9166μs | 40.1340 KOps/s | 41.6151 KOps/s | $\color{#d91a1a}-3.56\\%$ | | test_step_mdp_speed[True-True-True-True-False] | 63.4160μs | 14.5738μs | 68.6162 KOps/s | 70.6863 KOps/s | $\color{#d91a1a}-2.93\\%$ | | test_step_mdp_speed[True-True-True-False-True] | 46.2770μs | 14.3651μs | 69.6133 KOps/s | 72.3008 KOps/s | $\color{#d91a1a}-3.72\\%$ | | test_step_mdp_speed[True-True-True-False-False] | 0.1459ms | 8.4433μs | 118.4375 KOps/s | 123.2846 KOps/s | $\color{#d91a1a}-3.93\\%$ | | test_step_mdp_speed[True-True-False-True-True] | 0.1074ms | 26.2763μs | 38.0571 KOps/s | 39.3858 KOps/s | $\color{#d91a1a}-3.37\\%$ | | test_step_mdp_speed[True-True-False-True-False] | 59.2510μs | 16.1838μs | 61.7902 KOps/s | 64.3998 KOps/s | $\color{#d91a1a}-4.05\\%$ | | test_step_mdp_speed[True-True-False-False-True] | 44.2030μs | 15.8205μs | 63.2091 KOps/s | 65.4095 KOps/s | $\color{#d91a1a}-3.36\\%$ | | test_step_mdp_speed[True-True-False-False-False] | 65.3220μs | 9.9330μs | 100.6742 KOps/s | 103.8470 KOps/s | $\color{#d91a1a}-3.06\\%$ | | test_step_mdp_speed[True-False-True-True-True] | 63.7390μs | 28.3122μs | 35.3205 KOps/s | 36.3147 KOps/s | $\color{#d91a1a}-2.74\\%$ | | test_step_mdp_speed[True-False-True-True-False] | 85.3890μs | 17.4506μs | 57.3047 KOps/s | 57.6088 KOps/s | $\color{#d91a1a}-0.53\\%$ | | test_step_mdp_speed[True-False-True-False-True] | 42.6400μs | 15.8523μs | 63.0822 KOps/s | 61.7947 KOps/s | $\color{#35bf28}+2.08\\%$ | | test_step_mdp_speed[True-False-True-False-False] | 60.6330μs | 9.8826μs | 101.1883 KOps/s | 105.7728 KOps/s | $\color{#d91a1a}-4.33\\%$ | | test_step_mdp_speed[True-False-False-True-True] | 73.3470μs | 29.1838μs | 34.2656 KOps/s | 35.2774 KOps/s | $\color{#d91a1a}-2.87\\%$ | | test_step_mdp_speed[True-False-False-True-False] | 61.1340μs | 18.9482μs | 52.7754 KOps/s | 54.4318 KOps/s | $\color{#d91a1a}-3.04\\%$ | | test_step_mdp_speed[True-False-False-False-True] | 76.4930μs | 17.0663μs | 58.5951 KOps/s | 60.9684 KOps/s | $\color{#d91a1a}-3.89\\%$ | | test_step_mdp_speed[True-False-False-False-False] | 47.6790μs | 11.2999μs | 88.4963 KOps/s | 91.1928 KOps/s | $\color{#d91a1a}-2.96\\%$ | | test_step_mdp_speed[False-True-True-True-True] | 79.9490μs | 27.9217μs | 35.8144 KOps/s | 37.0598 KOps/s | $\color{#d91a1a}-3.36\\%$ | | test_step_mdp_speed[False-True-True-True-False] | 60.7640μs | 17.6854μs | 56.5438 KOps/s | 58.3396 KOps/s | $\color{#d91a1a}-3.08\\%$ | | test_step_mdp_speed[False-True-True-False-True] | 46.0350μs | 18.3071μs | 54.6237 KOps/s | 56.7398 KOps/s | $\color{#d91a1a}-3.73\\%$ | | test_step_mdp_speed[False-True-True-False-False] | 69.4200μs | 11.3425μs | 88.1641 KOps/s | 93.3329 KOps/s | $\textbf{\color{#d91a1a}-5.54\\%}$ | | test_step_mdp_speed[False-True-False-True-True] | 87.6140μs | 29.5642μs | 33.8247 KOps/s | 35.1853 KOps/s | $\color{#d91a1a}-3.87\\%$ | | test_step_mdp_speed[False-True-False-True-False] | 0.2667ms | 19.8781μs | 50.3066 KOps/s | 54.2067 KOps/s | $\textbf{\color{#d91a1a}-7.19\\%}$ | | test_step_mdp_speed[False-True-False-False-True] | 48.2910μs | 19.9604μs | 50.0992 KOps/s | 52.9419 KOps/s | $\textbf{\color{#d91a1a}-5.37\\%}$ | | test_step_mdp_speed[False-True-False-False-False] | 63.5790μs | 12.6612μs | 78.9813 KOps/s | 82.5505 KOps/s | $\color{#d91a1a}-4.32\\%$ | | test_step_mdp_speed[False-False-True-True-True] | 3.4728ms | 31.1777μs | 32.0742 KOps/s | 33.5765 KOps/s | $\color{#d91a1a}-4.47\\%$ | | test_step_mdp_speed[False-False-True-True-False] | 60.4420μs | 20.5309μs | 48.7071 KOps/s | 50.3641 KOps/s | $\color{#d91a1a}-3.29\\%$ | | test_step_mdp_speed[False-False-True-False-True] | 75.4810μs | 19.9567μs | 50.1084 KOps/s | 52.5030 KOps/s | $\color{#d91a1a}-4.56\\%$ | | test_step_mdp_speed[False-False-True-False-False] | 49.2020μs | 12.5905μs | 79.4252 KOps/s | 82.5206 KOps/s | $\color{#d91a1a}-3.75\\%$ | | test_step_mdp_speed[False-False-False-True-True] | 84.1370μs | 32.1434μs | 31.1106 KOps/s | 32.4813 KOps/s | $\color{#d91a1a}-4.22\\%$ | | test_step_mdp_speed[False-False-False-True-False] | 66.0640μs | 22.0607μs | 45.3296 KOps/s | 47.4854 KOps/s | $\color{#d91a1a}-4.54\\%$ | | test_step_mdp_speed[False-False-False-False-True] | 68.1370μs | 21.1877μs | 47.1971 KOps/s | 49.5527 KOps/s | $\color{#d91a1a}-4.75\\%$ | | test_step_mdp_speed[False-False-False-False-False] | 64.8210μs | 13.8479μs | 72.2131 KOps/s | 74.7506 KOps/s | $\color{#d91a1a}-3.39\\%$ | | test_values[generalized_advantage_estimate-True-True] | 13.1420ms | 9.4346ms | 105.9931 Ops/s | 101.6070 Ops/s | $\color{#35bf28}+4.32\\%$ | | test_values[vec_generalized_advantage_estimate-True-True] | 39.1115ms | 34.0916ms | 29.3327 Ops/s | 27.6928 Ops/s | $\textbf{\color{#35bf28}+5.92\\%}$ | | test_values[td0_return_estimate-False-False] | 0.2625ms | 0.1724ms | 5.8001 KOps/s | 5.3526 KOps/s | $\textbf{\color{#35bf28}+8.36\\%}$ | | test_values[td1_return_estimate-False-False] | 25.2616ms | 23.2472ms | 43.0159 Ops/s | 41.0231 Ops/s | $\color{#35bf28}+4.86\\%$ | | test_values[vec_td1_return_estimate-False-False] | 37.6983ms | 33.7935ms | 29.5915 Ops/s | 27.4688 Ops/s | $\textbf{\color{#35bf28}+7.73\\%}$ | | test_values[td_lambda_return_estimate-True-False] | 38.3014ms | 33.5394ms | 29.8157 Ops/s | 28.3400 Ops/s | $\textbf{\color{#35bf28}+5.21\\%}$ | | test_values[vec_td_lambda_return_estimate-True-False] | 36.1433ms | 33.7364ms | 29.6416 Ops/s | 27.7786 Ops/s | $\textbf{\color{#35bf28}+6.71\\%}$ | | test_gae_speed[generalized_advantage_estimate-False-1-512] | 8.4555ms | 8.2015ms | 121.9295 Ops/s | 118.2000 Ops/s | $\color{#35bf28}+3.16\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-True-1-512] | 2.1326ms | 1.7931ms | 557.6975 Ops/s | 479.4080 Ops/s | $\textbf{\color{#35bf28}+16.33\\%}$ | | test_gae_speed[vec_generalized_advantage_estimate-False-1-512] | 0.6317ms | 0.3631ms | 2.7544 KOps/s | 2.7450 KOps/s | $\color{#35bf28}+0.34\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-True-32-512] | 45.3551ms | 43.4806ms | 22.9988 Ops/s | 22.0236 Ops/s | $\color{#35bf28}+4.43\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-False-32-512] | 3.9080ms | 3.0576ms | 327.0494 Ops/s | 325.9718 Ops/s | $\color{#35bf28}+0.33\\%$ | | test_dqn_speed | 6.2751ms | 1.3170ms | 759.2768 Ops/s | 756.9368 Ops/s | $\color{#35bf28}+0.31\\%$ | | test_ddpg_speed | 3.5051ms | 2.7135ms | 368.5296 Ops/s | 362.2025 Ops/s | $\color{#35bf28}+1.75\\%$ | | test_sac_speed | 8.3750ms | 8.0120ms | 124.8121 Ops/s | 119.9520 Ops/s | $\color{#35bf28}+4.05\\%$ | | test_redq_speed | 14.5976ms | 12.7778ms | 78.2607 Ops/s | 75.9217 Ops/s | $\color{#35bf28}+3.08\\%$ | | test_redq_deprec_speed | 14.8677ms | 12.9184ms | 77.4090 Ops/s | 72.7786 Ops/s | $\textbf{\color{#35bf28}+6.36\\%}$ | | test_td3_speed | 8.6282ms | 8.0226ms | 124.6480 Ops/s | 120.7077 Ops/s | $\color{#35bf28}+3.26\\%$ | | test_cql_speed | 37.8811ms | 35.4511ms | 28.2078 Ops/s | 26.8561 Ops/s | $\textbf{\color{#35bf28}+5.03\\%}$ | | test_a2c_speed | 8.8747ms | 7.2588ms | 137.7642 Ops/s | 131.0662 Ops/s | $\textbf{\color{#35bf28}+5.11\\%}$ | | test_ppo_speed | 8.3388ms | 7.5468ms | 132.5066 Ops/s | 124.7461 Ops/s | $\textbf{\color{#35bf28}+6.22\\%}$ | | test_reinforce_speed | 8.5181ms | 6.4582ms | 154.8426 Ops/s | 149.3924 Ops/s | $\color{#35bf28}+3.65\\%$ | | test_iql_speed | 34.5743ms | 32.4930ms | 30.7759 Ops/s | 30.0518 Ops/s | $\color{#35bf28}+2.41\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 7.0085ms | 4.9329ms | 202.7189 Ops/s | 195.7711 Ops/s | $\color{#35bf28}+3.55\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 1.5606ms | 0.4748ms | 2.1061 KOps/s | 2.0237 KOps/s | $\color{#35bf28}+4.07\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.6027ms | 0.4499ms | 2.2228 KOps/s | 2.1359 KOps/s | $\color{#35bf28}+4.07\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 6.5110ms | 4.8062ms | 208.0628 Ops/s | 198.6367 Ops/s | $\color{#35bf28}+4.75\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 1.2824ms | 0.4674ms | 2.1396 KOps/s | 2.0451 KOps/s | $\color{#35bf28}+4.62\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.6807ms | 0.4486ms | 2.2291 KOps/s | 2.1251 KOps/s | $\color{#35bf28}+4.89\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] | 2.1766ms | 1.6656ms | 600.3676 Ops/s | 587.0563 Ops/s | $\color{#35bf28}+2.27\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] | 1.7612ms | 1.5756ms | 634.6904 Ops/s | 623.9374 Ops/s | $\color{#35bf28}+1.72\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 5.3580ms | 5.1539ms | 194.0280 Ops/s | 191.0208 Ops/s | $\color{#35bf28}+1.57\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 0.9480ms | 0.6084ms | 1.6436 KOps/s | 1.5684 KOps/s | $\color{#35bf28}+4.79\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 0.9215ms | 0.5863ms | 1.7055 KOps/s | 1.6554 KOps/s | $\color{#35bf28}+3.03\\%$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 6.1573ms | 4.8314ms | 206.9779 Ops/s | 193.4712 Ops/s | $\textbf{\color{#35bf28}+6.98\\%}$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 1.2031ms | 0.4780ms | 2.0921 KOps/s | 1.4349 KOps/s | $\textbf{\color{#35bf28}+45.80\\%}$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.6192ms | 0.4523ms | 2.2108 KOps/s | 2.0813 KOps/s | $\textbf{\color{#35bf28}+6.22\\%}$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 7.6920ms | 4.7906ms | 208.7404 Ops/s | 195.9019 Ops/s | $\textbf{\color{#35bf28}+6.55\\%}$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 0.5762ms | 0.4704ms | 2.1259 KOps/s | 1.8830 KOps/s | $\textbf{\color{#35bf28}+12.90\\%}$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 7.3402ms | 0.4584ms | 2.1814 KOps/s | 2.0556 KOps/s | $\textbf{\color{#35bf28}+6.12\\%}$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 7.1720ms | 5.0627ms | 197.5226 Ops/s | 190.4975 Ops/s | $\color{#35bf28}+3.69\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 1.0295ms | 0.6375ms | 1.5687 KOps/s | 1.5665 KOps/s | $\color{#35bf28}+0.14\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 0.8403ms | 0.5915ms | 1.6905 KOps/s | 1.5299 KOps/s | $\textbf{\color{#35bf28}+10.50\\%}$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] | 0.1257s | 8.2691ms | 120.9318 Ops/s | 153.7929 Ops/s | $\textbf{\color{#d91a1a}-21.37\\%}$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] | 17.4068ms | 12.9416ms | 77.2700 Ops/s | 73.8543 Ops/s | $\color{#35bf28}+4.62\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] | 1.8136ms | 1.1423ms | 875.4640 Ops/s | 809.4882 Ops/s | $\textbf{\color{#35bf28}+8.15\\%}$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] | 0.1076s | 5.7983ms | 172.4643 Ops/s | 161.1406 Ops/s | $\textbf{\color{#35bf28}+7.03\\%}$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] | 17.2869ms | 12.7997ms | 78.1270 Ops/s | 74.7278 Ops/s | $\color{#35bf28}+4.55\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] | 6.3418ms | 1.2409ms | 805.8653 Ops/s | 777.6527 Ops/s | $\color{#35bf28}+3.63\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] | 0.1122s | 6.0469ms | 165.3737 Ops/s | 113.4118 Ops/s | $\textbf{\color{#35bf28}+45.82\\%}$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] | 17.2026ms | 12.9260ms | 77.3632 Ops/s | 73.8223 Ops/s | $\color{#35bf28}+4.80\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] | 6.3292ms | 1.3739ms | 727.8315 Ops/s | 756.1542 Ops/s | $\color{#d91a1a}-3.75\\%$ |
github-actions[bot] commented 1 month ago

$\color{#D29922}\textsf{\Large\⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}2$. Worsened: $\large\color{#d91a1a}6$.

Expand to view detailed results | Name | Max | Mean | Ops | Ops on Repo `HEAD` | Change | | ----------------------------------------------------------------------------------------- | --------- | --------- | -------------- | ------------------ | ----------------------------------- | | test_single | 0.1124s | 0.1114s | 8.9794 Ops/s | 8.6256 Ops/s | $\color{#35bf28}+4.10\\%$ | | test_sync | 94.6639ms | 92.5596ms | 10.8039 Ops/s | 10.4998 Ops/s | $\color{#35bf28}+2.90\\%$ | | test_async | 0.1711s | 89.4896ms | 11.1745 Ops/s | 11.0330 Ops/s | $\color{#35bf28}+1.28\\%$ | | test_single_pixels | 0.1193s | 0.1192s | 8.3887 Ops/s | 8.6129 Ops/s | $\color{#d91a1a}-2.60\\%$ | | test_sync_pixels | 76.4528ms | 73.7785ms | 13.5541 Ops/s | 13.2225 Ops/s | $\color{#35bf28}+2.51\\%$ | | test_async_pixels | 0.1428s | 69.1525ms | 14.4608 Ops/s | 14.2936 Ops/s | $\color{#35bf28}+1.17\\%$ | | test_simple | 0.8923s | 0.8081s | 1.2375 Ops/s | 1.2813 Ops/s | $\color{#d91a1a}-3.42\\%$ | | test_transformed | 1.1191s | 1.0434s | 0.9585 Ops/s | 1.0115 Ops/s | $\textbf{\color{#d91a1a}-5.24\\%}$ | | test_serial | 2.3616s | 2.2836s | 0.4379 Ops/s | 0.4577 Ops/s | $\color{#d91a1a}-4.32\\%$ | | test_parallel | 1.9505s | 1.9418s | 0.5150 Ops/s | 0.5154 Ops/s | $\color{#d91a1a}-0.08\\%$ | | test_step_mdp_speed[True-True-True-True-True] | 0.1242ms | 35.5900μs | 28.0978 KOps/s | 28.3526 KOps/s | $\color{#d91a1a}-0.90\\%$ | | test_step_mdp_speed[True-True-True-True-False] | 46.1420μs | 20.1053μs | 49.7381 KOps/s | 49.8381 KOps/s | $\color{#d91a1a}-0.20\\%$ | | test_step_mdp_speed[True-True-True-False-True] | 0.1263ms | 20.3096μs | 49.2377 KOps/s | 49.5866 KOps/s | $\color{#d91a1a}-0.70\\%$ | | test_step_mdp_speed[True-True-True-False-False] | 33.3420μs | 11.5339μs | 86.7011 KOps/s | 87.5871 KOps/s | $\color{#d91a1a}-1.01\\%$ | | test_step_mdp_speed[True-True-False-True-True] | 70.5040μs | 37.5130μs | 26.6574 KOps/s | 26.8829 KOps/s | $\color{#d91a1a}-0.84\\%$ | | test_step_mdp_speed[True-True-False-True-False] | 46.7430μs | 22.1287μs | 45.1902 KOps/s | 45.2519 KOps/s | $\color{#d91a1a}-0.14\\%$ | | test_step_mdp_speed[True-True-False-False-True] | 60.3430μs | 22.1542μs | 45.1382 KOps/s | 45.9811 KOps/s | $\color{#d91a1a}-1.83\\%$ | | test_step_mdp_speed[True-True-False-False-False] | 79.8550μs | 13.5470μs | 73.8171 KOps/s | 74.0420 KOps/s | $\color{#d91a1a}-0.30\\%$ | | test_step_mdp_speed[True-False-True-True-True] | 71.0840μs | 39.8736μs | 25.0793 KOps/s | 25.4215 KOps/s | $\color{#d91a1a}-1.35\\%$ | | test_step_mdp_speed[True-False-True-True-False] | 48.4430μs | 24.3147μs | 41.1275 KOps/s | 41.2683 KOps/s | $\color{#d91a1a}-0.34\\%$ | | test_step_mdp_speed[True-False-True-False-True] | 0.2003ms | 22.6676μs | 44.1159 KOps/s | 45.9168 KOps/s | $\color{#d91a1a}-3.92\\%$ | | test_step_mdp_speed[True-False-True-False-False] | 34.7920μs | 13.6360μs | 73.3354 KOps/s | 74.2232 KOps/s | $\color{#d91a1a}-1.20\\%$ | | test_step_mdp_speed[True-False-False-True-True] | 0.1954ms | 41.5938μs | 24.0421 KOps/s | 24.2970 KOps/s | $\color{#d91a1a}-1.05\\%$ | | test_step_mdp_speed[True-False-False-True-False] | 0.1637ms | 26.1342μs | 38.2640 KOps/s | 37.7290 KOps/s | $\color{#35bf28}+1.42\\%$ | | test_step_mdp_speed[True-False-False-False-True] | 51.8730μs | 24.4812μs | 40.8476 KOps/s | 41.1336 KOps/s | $\color{#d91a1a}-0.70\\%$ | | test_step_mdp_speed[True-False-False-False-False] | 37.8220μs | 15.5787μs | 64.1904 KOps/s | 63.8569 KOps/s | $\color{#35bf28}+0.52\\%$ | | test_step_mdp_speed[False-True-True-True-True] | 76.4740μs | 39.0123μs | 25.6330 KOps/s | 25.3203 KOps/s | $\color{#35bf28}+1.23\\%$ | | test_step_mdp_speed[False-True-True-True-False] | 48.8540μs | 24.3194μs | 41.1194 KOps/s | 40.9482 KOps/s | $\color{#35bf28}+0.42\\%$ | | test_step_mdp_speed[False-True-True-False-True] | 65.4240μs | 26.0459μs | 38.3938 KOps/s | 38.2131 KOps/s | $\color{#35bf28}+0.47\\%$ | | test_step_mdp_speed[False-True-True-False-False] | 37.9420μs | 15.4748μs | 64.6214 KOps/s | 64.8945 KOps/s | $\color{#d91a1a}-0.42\\%$ | | test_step_mdp_speed[False-True-False-True-True] | 73.5940μs | 41.1306μs | 24.3128 KOps/s | 23.7963 KOps/s | $\color{#35bf28}+2.17\\%$ | | test_step_mdp_speed[False-True-False-True-False] | 52.5930μs | 26.1559μs | 38.2323 KOps/s | 37.8279 KOps/s | $\color{#35bf28}+1.07\\%$ | | test_step_mdp_speed[False-True-False-False-True] | 67.2640μs | 27.9506μs | 35.7774 KOps/s | 35.6908 KOps/s | $\color{#35bf28}+0.24\\%$ | | test_step_mdp_speed[False-True-False-False-False] | 40.5520μs | 17.4881μs | 57.1819 KOps/s | 55.8244 KOps/s | $\color{#35bf28}+2.43\\%$ | | test_step_mdp_speed[False-False-True-True-True] | 4.3067ms | 43.7889μs | 22.8369 KOps/s | 22.5189 KOps/s | $\color{#35bf28}+1.41\\%$ | | test_step_mdp_speed[False-False-True-True-False] | 0.2098ms | 28.3535μs | 35.2690 KOps/s | 34.5825 KOps/s | $\color{#35bf28}+1.99\\%$ | | test_step_mdp_speed[False-False-True-False-True] | 0.2256ms | 28.3211μs | 35.3094 KOps/s | 35.2424 KOps/s | $\color{#35bf28}+0.19\\%$ | | test_step_mdp_speed[False-False-True-False-False] | 45.1930μs | 17.3434μs | 57.6589 KOps/s | 56.3483 KOps/s | $\color{#35bf28}+2.33\\%$ | | test_step_mdp_speed[False-False-False-True-True] | 0.1677ms | 45.1574μs | 22.1447 KOps/s | 21.8057 KOps/s | $\color{#35bf28}+1.55\\%$ | | test_step_mdp_speed[False-False-False-True-False] | 57.4330μs | 30.3724μs | 32.9247 KOps/s | 32.6099 KOps/s | $\color{#35bf28}+0.97\\%$ | | test_step_mdp_speed[False-False-False-False-True] | 57.4430μs | 29.9799μs | 33.3556 KOps/s | 33.4410 KOps/s | $\color{#d91a1a}-0.26\\%$ | | test_step_mdp_speed[False-False-False-False-False] | 42.5220μs | 19.1296μs | 52.2750 KOps/s | 51.5512 KOps/s | $\color{#35bf28}+1.40\\%$ | | test_values[generalized_advantage_estimate-True-True] | 24.7928ms | 24.1371ms | 41.4300 Ops/s | 42.5759 Ops/s | $\color{#d91a1a}-2.69\\%$ | | test_values[vec_generalized_advantage_estimate-True-True] | 97.8477ms | 2.8444ms | 351.5740 Ops/s | 367.6558 Ops/s | $\color{#d91a1a}-4.37\\%$ | | test_values[td0_return_estimate-False-False] | 97.0950μs | 65.4869μs | 15.2702 KOps/s | 15.7065 KOps/s | $\color{#d91a1a}-2.78\\%$ | | test_values[td1_return_estimate-False-False] | 54.2980ms | 53.8093ms | 18.5842 Ops/s | 18.8142 Ops/s | $\color{#d91a1a}-1.22\\%$ | | test_values[vec_td1_return_estimate-False-False] | 1.3847ms | 1.0752ms | 930.0280 Ops/s | 926.9736 Ops/s | $\color{#35bf28}+0.33\\%$ | | test_values[td_lambda_return_estimate-True-False] | 86.0055ms | 85.6463ms | 11.6759 Ops/s | 11.8914 Ops/s | $\color{#d91a1a}-1.81\\%$ | | test_values[vec_td_lambda_return_estimate-True-False] | 1.2008ms | 1.0723ms | 932.6164 Ops/s | 929.6870 Ops/s | $\color{#35bf28}+0.32\\%$ | | test_gae_speed[generalized_advantage_estimate-False-1-512] | 24.3892ms | 24.0984ms | 41.4965 Ops/s | 42.1816 Ops/s | $\color{#d91a1a}-1.62\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-True-1-512] | 0.9976ms | 0.7117ms | 1.4051 KOps/s | 1.4213 KOps/s | $\color{#d91a1a}-1.14\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-False-1-512] | 0.8097ms | 0.6629ms | 1.5085 KOps/s | 1.5180 KOps/s | $\color{#d91a1a}-0.63\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-True-32-512] | 1.6193ms | 1.4630ms | 683.5453 Ops/s | 685.8882 Ops/s | $\color{#d91a1a}-0.34\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-False-32-512] | 0.8829ms | 0.6743ms | 1.4830 KOps/s | 1.4877 KOps/s | $\color{#d91a1a}-0.31\\%$ | | test_dqn_speed | 7.6927ms | 1.4256ms | 701.4353 Ops/s | 721.4850 Ops/s | $\color{#d91a1a}-2.78\\%$ | | test_ddpg_speed | 3.2114ms | 2.8623ms | 349.3723 Ops/s | 364.4935 Ops/s | $\color{#d91a1a}-4.15\\%$ | | test_sac_speed | 8.5077ms | 8.1565ms | 122.6016 Ops/s | 125.4542 Ops/s | $\color{#d91a1a}-2.27\\%$ | | test_redq_speed | 11.9997ms | 10.6343ms | 94.0354 Ops/s | 97.1595 Ops/s | $\color{#d91a1a}-3.22\\%$ | | test_redq_deprec_speed | 12.6516ms | 11.1476ms | 89.7053 Ops/s | 91.1726 Ops/s | $\color{#d91a1a}-1.61\\%$ | | test_td3_speed | 8.1242ms | 8.0657ms | 123.9812 Ops/s | 126.5211 Ops/s | $\color{#d91a1a}-2.01\\%$ | | test_cql_speed | 27.1993ms | 26.2062ms | 38.1589 Ops/s | 38.9849 Ops/s | $\color{#d91a1a}-2.12\\%$ | | test_a2c_speed | 6.1353ms | 5.8174ms | 171.8976 Ops/s | 175.5494 Ops/s | $\color{#d91a1a}-2.08\\%$ | | test_ppo_speed | 6.7814ms | 6.1664ms | 162.1696 Ops/s | 165.3435 Ops/s | $\color{#d91a1a}-1.92\\%$ | | test_reinforce_speed | 5.4646ms | 4.7471ms | 210.6565 Ops/s | 219.3989 Ops/s | $\color{#d91a1a}-3.98\\%$ | | test_iql_speed | 20.9342ms | 20.2059ms | 49.4906 Ops/s | 50.0176 Ops/s | $\color{#d91a1a}-1.05\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 7.0339ms | 6.7327ms | 148.5281 Ops/s | 151.1834 Ops/s | $\color{#d91a1a}-1.76\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.8907ms | 0.5321ms | 1.8793 KOps/s | 1.9263 KOps/s | $\color{#d91a1a}-2.44\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.7522ms | 0.5111ms | 1.9566 KOps/s | 1.9928 KOps/s | $\color{#d91a1a}-1.82\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 7.1204ms | 6.6912ms | 149.4510 Ops/s | 154.6439 Ops/s | $\color{#d91a1a}-3.36\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 2.0069ms | 0.5275ms | 1.8956 KOps/s | 1.9504 KOps/s | $\color{#d91a1a}-2.81\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.6888ms | 0.5071ms | 1.9720 KOps/s | 2.0213 KOps/s | $\color{#d91a1a}-2.44\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] | 2.4656ms | 2.0399ms | 490.2265 Ops/s | 515.3262 Ops/s | $\color{#d91a1a}-4.87\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] | 2.1950ms | 1.9476ms | 513.4602 Ops/s | 513.2251 Ops/s | $\color{#35bf28}+0.05\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 7.2163ms | 6.8623ms | 145.7234 Ops/s | 148.5049 Ops/s | $\color{#d91a1a}-1.87\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 1.0269ms | 0.6865ms | 1.4566 KOps/s | 1.4992 KOps/s | $\color{#d91a1a}-2.84\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 0.1390s | 0.7833ms | 1.2766 KOps/s | 1.5522 KOps/s | $\textbf{\color{#d91a1a}-17.75\\%}$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 7.0012ms | 6.7272ms | 148.6505 Ops/s | 151.7625 Ops/s | $\color{#d91a1a}-2.05\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 1.1385ms | 0.5363ms | 1.8647 KOps/s | 1.9233 KOps/s | $\color{#d91a1a}-3.05\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.7334ms | 0.5154ms | 1.9403 KOps/s | 1.9915 KOps/s | $\color{#d91a1a}-2.57\\%$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 7.1005ms | 6.6642ms | 150.0564 Ops/s | 152.7412 Ops/s | $\color{#d91a1a}-1.76\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 0.1360s | 0.7125ms | 1.4035 KOps/s | 1.9520 KOps/s | $\textbf{\color{#d91a1a}-28.10\\%}$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.7367ms | 0.5007ms | 1.9971 KOps/s | 1.9911 KOps/s | $\color{#35bf28}+0.30\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 7.1687ms | 6.8855ms | 145.2337 Ops/s | 148.3659 Ops/s | $\color{#d91a1a}-2.11\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 0.9127ms | 0.6859ms | 1.4580 KOps/s | 1.1636 KOps/s | $\textbf{\color{#35bf28}+25.31\\%}$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 0.8880ms | 0.6672ms | 1.4989 KOps/s | 1.5124 KOps/s | $\color{#d91a1a}-0.89\\%$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] | 0.1403s | 8.0407ms | 124.3669 Ops/s | 127.1561 Ops/s | $\color{#d91a1a}-2.19\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] | 19.6807ms | 16.0800ms | 62.1890 Ops/s | 64.8611 Ops/s | $\color{#d91a1a}-4.12\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] | 7.3929ms | 1.3840ms | 722.5236 Ops/s | 787.5646 Ops/s | $\textbf{\color{#d91a1a}-8.26\\%}$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] | 0.1373s | 10.5359ms | 94.9137 Ops/s | 128.7330 Ops/s | $\textbf{\color{#d91a1a}-26.27\\%}$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] | 18.4122ms | 15.9855ms | 62.5566 Ops/s | 63.6884 Ops/s | $\color{#d91a1a}-1.78\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] | 2.2429ms | 1.2106ms | 826.0292 Ops/s | 784.6455 Ops/s | $\textbf{\color{#35bf28}+5.27\\%}$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] | 0.1374s | 8.1849ms | 122.1765 Ops/s | 126.1415 Ops/s | $\color{#d91a1a}-3.14\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] | 18.6381ms | 16.2474ms | 61.5483 Ops/s | 63.9021 Ops/s | $\color{#d91a1a}-3.68\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] | 7.0719ms | 1.5259ms | 655.3381 Ops/s | 705.4073 Ops/s | $\textbf{\color{#d91a1a}-7.10\\%}$ |