search

pytorch / rl

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
https://pytorch.org/rl
MIT License
2.05k stars 273 forks source link

[Doc] Restore colab links #2197

Closed vmoens closed 1 month ago

vmoens commented 1 month ago

From https://github.com/pytorch/audio/blob/main/docs/source/_templates/layout.html#L61

pytorch-bot[bot] commented 1 month ago

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2197

Note: Links to docs will display an error until the docs builds have been completed.

:x: 12 New Failures, 6 Unrelated Failures

As of commit a516216e5218dc74914a42cd640877820df1d712 with merge base 3e6cb8419df56d9263d1daa48f9c3be5f01eaea6 (image):

NEW FAILURES - The following jobs have failed:

* [Habitat Tests on Linux / tests (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2197#25740867898) ([gh](https://github.com/pytorch/rl/actions/runs/9352515827/job/25740867898)) `RuntimeError: Command docker exec -t 3472b9983c251327e93cc3ceaca2706dfb937b3d1cb9a84de7aae199b2a2a860 /exec failed with exit code 1` * [Libs Tests on Linux / unittests-gym (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2197#25740875571) ([gh](https://github.com/pytorch/rl/actions/runs/9352515849/job/25740875571)) `RuntimeError: Command docker exec -t c20da89cd0503e26875d745af8f97c3e028388aaf41a90287f8096934f0e9747 /exec failed with exit code 1` * [Libs Tests on Linux / unittests-sklearn (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2197#25740875879) ([gh](https://github.com/pytorch/rl/actions/runs/9352515849/job/25740875879)) `RuntimeError: Command docker exec -t 07ec3ddea55fad8d727da64a9c67c8156468eb1fe2917245d9702ec652bfdc5e /exec failed with exit code 1` * [Lint / python-source-and-configs / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2197#25740867924) ([gh](https://github.com/pytorch/rl/actions/runs/9352515824/job/25740867924)) `RuntimeError: Command docker exec -t c2fa1d03251ea5f0f279734e16607ed1b11a0f727f570dc34045237e48e8a02c /exec failed with exit code 1` * [RLHF Tests on Linux / unittests (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2197#25740867594) ([gh](https://github.com/pytorch/rl/actions/runs/9352515820/job/25740867594)) `RuntimeError: Command docker exec -t ff21fe4bc0fd8330321765944d87fa7fa57f5760e4d44486c7e7aad54809926e /exec failed with exit code 1` * [Unit-tests on Linux / tests-optdeps (3.10, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2197#25740871987) ([gh](https://github.com/pytorch/rl/actions/runs/9352515834/job/25740871987)) `RuntimeError: Command docker exec -t ed2dfee13e92d3adf99d181b8a3ea1328672d52e55740072bc21fbd261171d0d /exec failed with exit code 1` * [Wheels / test-wheel (linux, ubuntu-20.04, 3.10)](https://hud.pytorch.org/pr/pytorch/rl/2197#25740970333) ([gh](https://github.com/pytorch/rl/actions/runs/9352515792/job/25740970333)) `##[error]The operation was canceled.` * [Wheels / test-wheel (linux, ubuntu-20.04, 3.11)](https://hud.pytorch.org/pr/pytorch/rl/2197#25740970717) ([gh](https://github.com/pytorch/rl/actions/runs/9352515792/job/25740970717)) `ModuleNotFoundError: No module named 'dm_env'` * [Wheels / test-wheel (linux, ubuntu-20.04, 3.8)](https://hud.pytorch.org/pr/pytorch/rl/2197#25740969559) ([gh](https://github.com/pytorch/rl/actions/runs/9352515792/job/25740969559)) `##[error]The operation was canceled.` * [Wheels / test-wheel (linux, ubuntu-20.04, 3.9)](https://hud.pytorch.org/pr/pytorch/rl/2197#25740970024) ([gh](https://github.com/pytorch/rl/actions/runs/9352515792/job/25740970024)) `##[error]The operation was canceled.` * [Wheels / test-wheel-windows (3.10)](https://hud.pytorch.org/pr/pytorch/rl/2197#25741081843) ([gh](https://github.com/pytorch/rl/actions/runs/9352515792/job/25741081843)) `ModuleNotFoundError: No module named 'dm_env'` * [Wheels / test-wheel-windows (3.8)](https://hud.pytorch.org/pr/pytorch/rl/2197#25741081020) ([gh](https://github.com/pytorch/rl/actions/runs/9352515792/job/25741081020)) `ModuleNotFoundError: No module named 'dm_env'`

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

* [Wheels / test-wheel-windows (3.11)](https://hud.pytorch.org/pr/pytorch/rl/2197#25741082282) ([gh](https://github.com/pytorch/rl/actions/runs/9352515792/job/25741082282)) (matched **win** rule in [flaky-rules.json](https://github.com/pytorch/test-infra/blob/generated-stats/stats/flaky-rules.json)) `##[error]The operation was canceled.` * [Wheels / test-wheel-windows (3.9)](https://hud.pytorch.org/pr/pytorch/rl/2197#25741081443) ([gh](https://github.com/pytorch/rl/actions/runs/9352515792/job/25741081443)) (matched **win** rule in [flaky-rules.json](https://github.com/pytorch/test-infra/blob/generated-stats/stats/flaky-rules.json)) `##[error]The operation was canceled.`

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

* [Unit-tests on Linux / tests-cpu (3.8) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2197#25740870567) ([gh](https://github.com/pytorch/rl/actions/runs/9352515834/job/25740870567)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/3e6cb8419df56d9263d1daa48f9c3be5f01eaea6#25732289709)) `test/test_trainer.py::TestRecorder::test_recorder_load[torch]` * [Unit-tests on Linux / tests-cpu (3.9) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2197#25740870896) ([gh](https://github.com/pytorch/rl/actions/runs/9352515834/job/25740870896)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/3e6cb8419df56d9263d1daa48f9c3be5f01eaea6#25732291776)) `test/test_trainer.py::TestRecorder::test_recorder_load[torch]` * [Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2197#25740871644) ([gh](https://github.com/pytorch/rl/actions/runs/9352515834/job/25740871644)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/3e6cb8419df56d9263d1daa48f9c3be5f01eaea6#25732293653)) `test/test_transforms.py::TestVecNorm::test_state_dict_vecnorm` * [Unit-tests on Windows / unittests-cpu / windows-job](https://hud.pytorch.org/pr/pytorch/rl/2197#25740872507) ([gh](https://github.com/pytorch/rl/actions/runs/9352515832/job/25740872507)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/3e6cb8419df56d9263d1daa48f9c3be5f01eaea6#25732286828)) `ModuleNotFoundError: No module named 'dm_env'`

This comment was automatically generated by Dr. CI and updates every 15 minutes.

github-actions[bot] commented 1 month ago

$\color{#D29922}\textsf{\Large\⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}8$.

Expand to view detailed results | Name | Max | Mean | Ops | Ops on Repo `HEAD` | Change | | ----------------------------------------------------------------------------------------- | --------- | --------- | --------------- | ------------------ | ----------------------------------- | | test_single | 0.1121s | 59.3944ms | 16.8366 Ops/s | 17.3297 Ops/s | $\color{#d91a1a}-2.85\\%$ | | test_sync | 36.7342ms | 31.2497ms | 32.0003 Ops/s | 31.0415 Ops/s | $\color{#35bf28}+3.09\\%$ | | test_async | 56.8700ms | 29.1372ms | 34.3204 Ops/s | 35.2072 Ops/s | $\color{#d91a1a}-2.52\\%$ | | test_simple | 0.4482s | 0.3899s | 2.5648 Ops/s | 2.5503 Ops/s | $\color{#35bf28}+0.57\\%$ | | test_transformed | 0.5378s | 0.5359s | 1.8660 Ops/s | 1.7844 Ops/s | $\color{#35bf28}+4.57\\%$ | | test_serial | 1.3335s | 1.2822s | 0.7799 Ops/s | 0.7661 Ops/s | $\color{#35bf28}+1.80\\%$ | | test_parallel | 1.1520s | 1.0866s | 0.9203 Ops/s | 0.9120 Ops/s | $\color{#35bf28}+0.92\\%$ | | test_step_mdp_speed[True-True-True-True-True] | 0.2346ms | 21.7911μs | 45.8903 KOps/s | 46.4350 KOps/s | $\color{#d91a1a}-1.17\\%$ | | test_step_mdp_speed[True-True-True-True-False] | 72.4750μs | 13.2717μs | 75.3483 KOps/s | 75.7345 KOps/s | $\color{#d91a1a}-0.51\\%$ | | test_step_mdp_speed[True-True-True-False-True] | 0.1412ms | 13.0756μs | 76.4782 KOps/s | 79.8835 KOps/s | $\color{#d91a1a}-4.26\\%$ | | test_step_mdp_speed[True-True-True-False-False] | 25.6880μs | 7.7229μs | 129.4843 KOps/s | 131.1339 KOps/s | $\color{#d91a1a}-1.26\\%$ | | test_step_mdp_speed[True-True-False-True-True] | 47.3580μs | 23.0799μs | 43.3277 KOps/s | 43.6946 KOps/s | $\color{#d91a1a}-0.84\\%$ | | test_step_mdp_speed[True-True-False-True-False] | 63.4580μs | 14.6511μs | 68.2545 KOps/s | 69.5358 KOps/s | $\color{#d91a1a}-1.84\\%$ | | test_step_mdp_speed[True-True-False-False-True] | 58.6290μs | 14.0506μs | 71.1716 KOps/s | 71.4344 KOps/s | $\color{#d91a1a}-0.37\\%$ | | test_step_mdp_speed[True-True-False-False-False] | 42.9000μs | 9.0311μs | 110.7291 KOps/s | 112.0118 KOps/s | $\color{#d91a1a}-1.15\\%$ | | test_step_mdp_speed[True-False-True-True-True] | 54.8820μs | 24.6275μs | 40.6050 KOps/s | 41.1194 KOps/s | $\color{#d91a1a}-1.25\\%$ | | test_step_mdp_speed[True-False-True-True-False] | 0.1353ms | 15.9148μs | 62.8345 KOps/s | 63.2953 KOps/s | $\color{#d91a1a}-0.73\\%$ | | test_step_mdp_speed[True-False-True-False-True] | 0.1209ms | 14.1846μs | 70.4988 KOps/s | 71.8840 KOps/s | $\color{#d91a1a}-1.93\\%$ | | test_step_mdp_speed[True-False-True-False-False] | 33.1020μs | 9.0621μs | 110.3497 KOps/s | 111.5738 KOps/s | $\color{#d91a1a}-1.10\\%$ | | test_step_mdp_speed[True-False-False-True-True] | 86.7520μs | 25.9261μs | 38.5711 KOps/s | 39.4569 KOps/s | $\color{#d91a1a}-2.24\\%$ | | test_step_mdp_speed[True-False-False-True-False] | 50.3740μs | 17.2316μs | 58.0328 KOps/s | 59.1698 KOps/s | $\color{#d91a1a}-1.92\\%$ | | test_step_mdp_speed[True-False-False-False-True] | 50.7050μs | 15.1953μs | 65.8098 KOps/s | 66.6862 KOps/s | $\color{#d91a1a}-1.31\\%$ | | test_step_mdp_speed[True-False-False-False-False] | 40.9260μs | 10.2569μs | 97.4952 KOps/s | 99.6738 KOps/s | $\color{#d91a1a}-2.19\\%$ | | test_step_mdp_speed[False-True-True-True-True] | 0.1228ms | 24.7727μs | 40.3670 KOps/s | 41.2227 KOps/s | $\color{#d91a1a}-2.08\\%$ | | test_step_mdp_speed[False-True-True-True-False] | 43.3410μs | 15.9048μs | 62.8740 KOps/s | 63.8256 KOps/s | $\color{#d91a1a}-1.49\\%$ | | test_step_mdp_speed[False-True-True-False-True] | 79.8590μs | 16.5803μs | 60.3125 KOps/s | 61.5272 KOps/s | $\color{#d91a1a}-1.97\\%$ | | test_step_mdp_speed[False-True-True-False-False] | 29.9760μs | 10.3720μs | 96.4135 KOps/s | 98.7191 KOps/s | $\color{#d91a1a}-2.34\\%$ | | test_step_mdp_speed[False-True-False-True-True] | 56.4050μs | 25.8507μs | 38.6836 KOps/s | 39.0665 KOps/s | $\color{#d91a1a}-0.98\\%$ | | test_step_mdp_speed[False-True-False-True-False] | 41.9280μs | 17.1849μs | 58.1906 KOps/s | 58.0734 KOps/s | $\color{#35bf28}+0.20\\%$ | | test_step_mdp_speed[False-True-False-False-True] | 57.5580μs | 17.6843μs | 56.5473 KOps/s | 57.5028 KOps/s | $\color{#d91a1a}-1.66\\%$ | | test_step_mdp_speed[False-True-False-False-False] | 45.3040μs | 11.4310μs | 87.4817 KOps/s | 87.7366 KOps/s | $\color{#d91a1a}-0.29\\%$ | | test_step_mdp_speed[False-False-True-True-True] | 57.8070μs | 27.2365μs | 36.7154 KOps/s | 36.9020 KOps/s | $\color{#d91a1a}-0.51\\%$ | | test_step_mdp_speed[False-False-True-True-False] | 45.0240μs | 18.3419μs | 54.5201 KOps/s | 54.4778 KOps/s | $\color{#35bf28}+0.08\\%$ | | test_step_mdp_speed[False-False-True-False-True] | 65.7830μs | 17.8453μs | 56.0373 KOps/s | 56.8367 KOps/s | $\color{#d91a1a}-1.41\\%$ | | test_step_mdp_speed[False-False-True-False-False] | 36.2380μs | 11.5582μs | 86.5183 KOps/s | 87.4177 KOps/s | $\color{#d91a1a}-1.03\\%$ | | test_step_mdp_speed[False-False-False-True-True] | 54.4520μs | 29.0033μs | 34.4789 KOps/s | 34.6333 KOps/s | $\color{#d91a1a}-0.45\\%$ | | test_step_mdp_speed[False-False-False-True-False] | 53.6100μs | 19.7919μs | 50.5257 KOps/s | 51.0905 KOps/s | $\color{#d91a1a}-1.11\\%$ | | test_step_mdp_speed[False-False-False-False-True] | 48.6610μs | 18.9486μs | 52.7743 KOps/s | 54.0938 KOps/s | $\color{#d91a1a}-2.44\\%$ | | test_step_mdp_speed[False-False-False-False-False] | 52.9880μs | 12.7008μs | 78.7354 KOps/s | 80.3360 KOps/s | $\color{#d91a1a}-1.99\\%$ | | test_values[generalized_advantage_estimate-True-True] | 12.4275ms | 9.7221ms | 102.8585 Ops/s | 106.1664 Ops/s | $\color{#d91a1a}-3.12\\%$ | | test_values[vec_generalized_advantage_estimate-True-True] | 55.3092ms | 36.2604ms | 27.5783 Ops/s | 28.0450 Ops/s | $\color{#d91a1a}-1.66\\%$ | | test_values[td0_return_estimate-False-False] | 0.2840ms | 0.1711ms | 5.8451 KOps/s | 5.9985 KOps/s | $\color{#d91a1a}-2.56\\%$ | | test_values[td1_return_estimate-False-False] | 27.2269ms | 24.2973ms | 41.1568 Ops/s | 41.9322 Ops/s | $\color{#d91a1a}-1.85\\%$ | | test_values[vec_td1_return_estimate-False-False] | 38.5537ms | 35.9772ms | 27.7954 Ops/s | 27.9018 Ops/s | $\color{#d91a1a}-0.38\\%$ | | test_values[td_lambda_return_estimate-True-False] | 38.4331ms | 35.0575ms | 28.5246 Ops/s | 28.7255 Ops/s | $\color{#d91a1a}-0.70\\%$ | | test_values[vec_td_lambda_return_estimate-True-False] | 39.2750ms | 36.1170ms | 27.6878 Ops/s | 27.9542 Ops/s | $\color{#d91a1a}-0.95\\%$ | | test_gae_speed[generalized_advantage_estimate-False-1-512] | 9.8704ms | 8.4618ms | 118.1784 Ops/s | 120.5946 Ops/s | $\color{#d91a1a}-2.00\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-True-1-512] | 2.5450ms | 1.9541ms | 511.7467 Ops/s | 501.0527 Ops/s | $\color{#35bf28}+2.13\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-False-1-512] | 0.5682ms | 0.3645ms | 2.7437 KOps/s | 2.7961 KOps/s | $\color{#d91a1a}-1.88\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-True-32-512] | 66.8354ms | 42.9498ms | 23.2830 Ops/s | 22.7560 Ops/s | $\color{#35bf28}+2.32\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-False-32-512] | 3.7930ms | 3.0803ms | 324.6394 Ops/s | 326.9126 Ops/s | $\color{#d91a1a}-0.70\\%$ | | test_dqn_speed | 1.7449ms | 1.3964ms | 716.1339 Ops/s | 716.0729 Ops/s | $+0.01\\%$ | | test_ddpg_speed | 3.6344ms | 2.9402ms | 340.1122 Ops/s | 340.0982 Ops/s | $+0.00\\%$ | | test_sac_speed | 10.5421ms | 8.7243ms | 114.6219 Ops/s | 114.4483 Ops/s | $\color{#35bf28}+0.15\\%$ | | test_redq_speed | 14.9140ms | 13.7290ms | 72.8383 Ops/s | 69.7764 Ops/s | $\color{#35bf28}+4.39\\%$ | | test_redq_deprec_speed | 16.6628ms | 13.8625ms | 72.1368 Ops/s | 63.6570 Ops/s | $\textbf{\color{#35bf28}+13.32\\%}$ | | test_td3_speed | 17.7211ms | 8.9719ms | 111.4593 Ops/s | 116.7610 Ops/s | $\color{#d91a1a}-4.54\\%$ | | test_cql_speed | 38.6229ms | 37.2785ms | 26.8251 Ops/s | 27.0199 Ops/s | $\color{#d91a1a}-0.72\\%$ | | test_a2c_speed | 8.7279ms | 7.6145ms | 131.3283 Ops/s | 132.3397 Ops/s | $\color{#d91a1a}-0.76\\%$ | | test_ppo_speed | 9.6707ms | 8.1790ms | 122.2644 Ops/s | 123.4254 Ops/s | $\color{#d91a1a}-0.94\\%$ | | test_reinforce_speed | 8.4189ms | 7.1384ms | 140.0866 Ops/s | 149.6300 Ops/s | $\textbf{\color{#d91a1a}-6.38\\%}$ | | test_iql_speed | 36.4435ms | 34.4262ms | 29.0476 Ops/s | 30.3381 Ops/s | $\color{#d91a1a}-4.25\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 4.1144ms | 3.7175ms | 269.0001 Ops/s | 286.1865 Ops/s | $\textbf{\color{#d91a1a}-6.01\\%}$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.9940ms | 0.5060ms | 1.9764 KOps/s | 1.7647 KOps/s | $\textbf{\color{#35bf28}+12.00\\%}$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.7848ms | 0.4824ms | 2.0732 KOps/s | 2.0896 KOps/s | $\color{#d91a1a}-0.78\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 4.5083ms | 3.6796ms | 271.7669 Ops/s | 286.9247 Ops/s | $\textbf{\color{#d91a1a}-5.28\\%}$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 1.0704ms | 0.5010ms | 1.9960 KOps/s | 2.0187 KOps/s | $\color{#d91a1a}-1.12\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.7220ms | 0.4783ms | 2.0909 KOps/s | 2.1208 KOps/s | $\color{#d91a1a}-1.41\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] | 1.8016ms | 1.2753ms | 784.1352 Ops/s | 792.3745 Ops/s | $\color{#d91a1a}-1.04\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] | 1.6269ms | 1.1978ms | 834.8575 Ops/s | 839.1248 Ops/s | $\color{#d91a1a}-0.51\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 5.6440ms | 3.8157ms | 262.0767 Ops/s | 278.6081 Ops/s | $\textbf{\color{#d91a1a}-5.93\\%}$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 1.0030ms | 0.6241ms | 1.6024 KOps/s | 1.6140 KOps/s | $\color{#d91a1a}-0.72\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 0.8966ms | 0.6027ms | 1.6592 KOps/s | 1.6872 KOps/s | $\color{#d91a1a}-1.66\\%$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 5.4868ms | 3.6885ms | 271.1121 Ops/s | 287.3885 Ops/s | $\textbf{\color{#d91a1a}-5.66\\%}$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.7511ms | 0.5109ms | 1.9575 KOps/s | 1.9958 KOps/s | $\color{#d91a1a}-1.92\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 3.6290ms | 0.4848ms | 2.0629 KOps/s | 2.0596 KOps/s | $\color{#35bf28}+0.16\\%$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 4.4062ms | 3.7196ms | 268.8496 Ops/s | 276.2326 Ops/s | $\color{#d91a1a}-2.67\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 0.6293ms | 0.5036ms | 1.9857 KOps/s | 1.9517 KOps/s | $\color{#35bf28}+1.74\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.8008ms | 0.4830ms | 2.0704 KOps/s | 2.0373 KOps/s | $\color{#35bf28}+1.62\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 4.2569ms | 3.8938ms | 256.8179 Ops/s | 254.9962 Ops/s | $\color{#35bf28}+0.71\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 1.1684ms | 0.6469ms | 1.5457 KOps/s | 1.5632 KOps/s | $\color{#d91a1a}-1.12\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 0.9577ms | 0.6245ms | 1.6014 KOps/s | 1.6789 KOps/s | $\color{#d91a1a}-4.62\\%$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] | 0.1247s | 6.2385ms | 160.2951 Ops/s | 127.3236 Ops/s | $\textbf{\color{#35bf28}+25.90\\%}$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] | 15.6573ms | 12.7800ms | 78.2473 Ops/s | 78.7734 Ops/s | $\color{#d91a1a}-0.67\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] | 3.8729ms | 1.1771ms | 849.5359 Ops/s | 926.8344 Ops/s | $\textbf{\color{#d91a1a}-8.34\\%}$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] | 0.1227s | 8.6441ms | 115.6858 Ops/s | 177.2875 Ops/s | $\textbf{\color{#d91a1a}-34.75\\%}$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] | 15.1225ms | 12.8438ms | 77.8587 Ops/s | 79.3366 Ops/s | $\color{#d91a1a}-1.86\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] | 3.7001ms | 1.1479ms | 871.1713 Ops/s | 894.0929 Ops/s | $\color{#d91a1a}-2.56\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] | 0.1203s | 6.4995ms | 153.8582 Ops/s | 121.3183 Ops/s | $\textbf{\color{#35bf28}+26.82\\%}$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] | 21.2913ms | 13.1768ms | 75.8912 Ops/s | 76.8176 Ops/s | $\color{#d91a1a}-1.21\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] | 4.5703ms | 1.4911ms | 670.6598 Ops/s | 715.8532 Ops/s | $\textbf{\color{#d91a1a}-6.31\\%}$ |
github-actions[bot] commented 1 month ago

$\color{#D29922}\textsf{\Large\⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}2$.

Expand to view detailed results | Name | Max | Mean | Ops | Ops on Repo `HEAD` | Change | | ----------------------------------------------------------------------------------------- | --------- | --------- | -------------- | ------------------ | ----------------------------------- | | test_single | 0.1151s | 0.1149s | 8.7005 Ops/s | 8.5429 Ops/s | $\color{#35bf28}+1.85\\%$ | | test_sync | 0.1071s | 0.1028s | 9.7308 Ops/s | 9.7159 Ops/s | $\color{#35bf28}+0.15\\%$ | | test_async | 0.1996s | 96.4807ms | 10.3648 Ops/s | 10.2761 Ops/s | $\color{#35bf28}+0.86\\%$ | | test_single_pixels | 0.1264s | 0.1263s | 7.9184 Ops/s | 7.8595 Ops/s | $\color{#35bf28}+0.75\\%$ | | test_sync_pixels | 84.6631ms | 82.3746ms | 12.1397 Ops/s | 12.2235 Ops/s | $\color{#d91a1a}-0.69\\%$ | | test_async_pixels | 0.1548s | 68.1607ms | 14.6712 Ops/s | 14.3450 Ops/s | $\color{#35bf28}+2.27\\%$ | | test_simple | 0.8657s | 0.8047s | 1.2426 Ops/s | 1.2215 Ops/s | $\color{#35bf28}+1.73\\%$ | | test_transformed | 1.1150s | 1.0550s | 0.9479 Ops/s | 0.9344 Ops/s | $\color{#35bf28}+1.44\\%$ | | test_serial | 2.4988s | 2.4414s | 0.4096 Ops/s | 0.4020 Ops/s | $\color{#35bf28}+1.89\\%$ | | test_parallel | 2.4579s | 2.3593s | 0.4239 Ops/s | 0.4218 Ops/s | $\color{#35bf28}+0.48\\%$ | | test_step_mdp_speed[True-True-True-True-True] | 67.3710μs | 32.5987μs | 30.6761 KOps/s | 30.1276 KOps/s | $\color{#35bf28}+1.82\\%$ | | test_step_mdp_speed[True-True-True-True-False] | 34.2410μs | 19.2579μs | 51.9266 KOps/s | 50.1429 KOps/s | $\color{#35bf28}+3.56\\%$ | | test_step_mdp_speed[True-True-True-False-True] | 0.1162ms | 18.2276μs | 54.8620 KOps/s | 52.3143 KOps/s | $\color{#35bf28}+4.87\\%$ | | test_step_mdp_speed[True-True-True-False-False] | 32.8410μs | 11.0457μs | 90.5330 KOps/s | 86.9882 KOps/s | $\color{#35bf28}+4.08\\%$ | | test_step_mdp_speed[True-True-False-True-True] | 71.7210μs | 34.6262μs | 28.8799 KOps/s | 28.2027 KOps/s | $\color{#35bf28}+2.40\\%$ | | test_step_mdp_speed[True-True-False-True-False] | 48.6010μs | 21.2300μs | 47.1032 KOps/s | 45.9936 KOps/s | $\color{#35bf28}+2.41\\%$ | | test_step_mdp_speed[True-True-False-False-True] | 43.4010μs | 20.2784μs | 49.3137 KOps/s | 47.7237 KOps/s | $\color{#35bf28}+3.33\\%$ | | test_step_mdp_speed[True-True-False-False-False] | 31.7100μs | 12.9332μs | 77.3206 KOps/s | 74.7680 KOps/s | $\color{#35bf28}+3.41\\%$ | | test_step_mdp_speed[True-False-True-True-True] | 98.1120μs | 35.4379μs | 28.2183 KOps/s | 26.7741 KOps/s | $\textbf{\color{#35bf28}+5.39\\%}$ | | test_step_mdp_speed[True-False-True-True-False] | 63.3410μs | 23.1208μs | 43.2512 KOps/s | 41.8715 KOps/s | $\color{#35bf28}+3.29\\%$ | | test_step_mdp_speed[True-False-True-False-True] | 44.2110μs | 20.3336μs | 49.1797 KOps/s | 48.1549 KOps/s | $\color{#35bf28}+2.13\\%$ | | test_step_mdp_speed[True-False-True-False-False] | 38.3200μs | 13.0304μs | 76.7436 KOps/s | 75.2384 KOps/s | $\color{#35bf28}+2.00\\%$ | | test_step_mdp_speed[True-False-False-True-True] | 59.3920μs | 37.6729μs | 26.5443 KOps/s | 25.6965 KOps/s | $\color{#35bf28}+3.30\\%$ | | test_step_mdp_speed[True-False-False-True-False] | 55.5610μs | 24.8265μs | 40.2795 KOps/s | 38.9426 KOps/s | $\color{#35bf28}+3.43\\%$ | | test_step_mdp_speed[True-False-False-False-True] | 46.8410μs | 22.0959μs | 45.2572 KOps/s | 44.6833 KOps/s | $\color{#35bf28}+1.28\\%$ | | test_step_mdp_speed[True-False-False-False-False] | 37.5120μs | 14.7316μs | 67.8813 KOps/s | 66.3832 KOps/s | $\color{#35bf28}+2.26\\%$ | | test_step_mdp_speed[False-True-True-True-True] | 64.4310μs | 36.1577μs | 27.6566 KOps/s | 26.9486 KOps/s | $\color{#35bf28}+2.63\\%$ | | test_step_mdp_speed[False-True-True-True-False] | 62.0020μs | 23.1291μs | 43.2356 KOps/s | 42.1646 KOps/s | $\color{#35bf28}+2.54\\%$ | | test_step_mdp_speed[False-True-True-False-True] | 43.0500μs | 24.5738μs | 40.6938 KOps/s | 39.6363 KOps/s | $\color{#35bf28}+2.67\\%$ | | test_step_mdp_speed[False-True-True-False-False] | 50.7810μs | 14.5840μs | 68.5685 KOps/s | 65.3995 KOps/s | $\color{#35bf28}+4.85\\%$ | | test_step_mdp_speed[False-True-False-True-True] | 63.9910μs | 37.5367μs | 26.6406 KOps/s | 25.5905 KOps/s | $\color{#35bf28}+4.10\\%$ | | test_step_mdp_speed[False-True-False-True-False] | 47.1410μs | 24.7823μs | 40.3513 KOps/s | 38.9334 KOps/s | $\color{#35bf28}+3.64\\%$ | | test_step_mdp_speed[False-True-False-False-True] | 63.1420μs | 26.6787μs | 37.4831 KOps/s | 36.9098 KOps/s | $\color{#35bf28}+1.55\\%$ | | test_step_mdp_speed[False-True-False-False-False] | 49.8310μs | 16.5429μs | 60.4487 KOps/s | 59.3030 KOps/s | $\color{#35bf28}+1.93\\%$ | | test_step_mdp_speed[False-False-True-True-True] | 0.1054ms | 39.6581μs | 25.2156 KOps/s | 24.2911 KOps/s | $\color{#35bf28}+3.81\\%$ | | test_step_mdp_speed[False-False-True-True-False] | 48.9200μs | 26.8293μs | 37.2727 KOps/s | 36.2430 KOps/s | $\color{#35bf28}+2.84\\%$ | | test_step_mdp_speed[False-False-True-False-True] | 51.6710μs | 26.2882μs | 38.0398 KOps/s | 37.0517 KOps/s | $\color{#35bf28}+2.67\\%$ | | test_step_mdp_speed[False-False-True-False-False] | 52.6820μs | 16.4855μs | 60.6595 KOps/s | 58.8086 KOps/s | $\color{#35bf28}+3.15\\%$ | | test_step_mdp_speed[False-False-False-True-True] | 64.6910μs | 41.4595μs | 24.1199 KOps/s | 23.2774 KOps/s | $\color{#35bf28}+3.62\\%$ | | test_step_mdp_speed[False-False-False-True-False] | 57.5910μs | 28.7960μs | 34.7271 KOps/s | 33.9383 KOps/s | $\color{#35bf28}+2.32\\%$ | | test_step_mdp_speed[False-False-False-False-True] | 49.4310μs | 27.6698μs | 36.1405 KOps/s | 35.1616 KOps/s | $\color{#35bf28}+2.78\\%$ | | test_step_mdp_speed[False-False-False-False-False] | 56.6510μs | 18.2090μs | 54.9179 KOps/s | 53.7021 KOps/s | $\color{#35bf28}+2.26\\%$ | | test_values[generalized_advantage_estimate-True-True] | 24.7159ms | 24.1661ms | 41.3803 Ops/s | 39.7189 Ops/s | $\color{#35bf28}+4.18\\%$ | | test_values[vec_generalized_advantage_estimate-True-True] | 83.3334ms | 3.2328ms | 309.3271 Ops/s | 312.2267 Ops/s | $\color{#d91a1a}-0.93\\%$ | | test_values[td0_return_estimate-False-False] | 91.7730μs | 63.0255μs | 15.8666 KOps/s | 15.5584 KOps/s | $\color{#35bf28}+1.98\\%$ | | test_values[td1_return_estimate-False-False] | 52.2597ms | 51.9741ms | 19.2403 Ops/s | 19.0504 Ops/s | $\color{#35bf28}+1.00\\%$ | | test_values[vec_td1_return_estimate-False-False] | 1.9922ms | 1.7604ms | 568.0386 Ops/s | 564.9897 Ops/s | $\color{#35bf28}+0.54\\%$ | | test_values[td_lambda_return_estimate-True-False] | 83.0371ms | 82.6298ms | 12.1022 Ops/s | 11.9652 Ops/s | $\color{#35bf28}+1.14\\%$ | | test_values[vec_td_lambda_return_estimate-True-False] | 1.9616ms | 1.7570ms | 569.1546 Ops/s | 565.9793 Ops/s | $\color{#35bf28}+0.56\\%$ | | test_gae_speed[generalized_advantage_estimate-False-1-512] | 23.1480ms | 23.0423ms | 43.3984 Ops/s | 42.4050 Ops/s | $\color{#35bf28}+2.34\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-True-1-512] | 0.8850ms | 0.6929ms | 1.4432 KOps/s | 1.4367 KOps/s | $\color{#35bf28}+0.45\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-False-1-512] | 0.7225ms | 0.6494ms | 1.5398 KOps/s | 1.5260 KOps/s | $\color{#35bf28}+0.91\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-True-32-512] | 1.4760ms | 1.4480ms | 690.5842 Ops/s | 688.5274 Ops/s | $\color{#35bf28}+0.30\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-False-32-512] | 0.9319ms | 0.6669ms | 1.4995 KOps/s | 1.4866 KOps/s | $\color{#35bf28}+0.86\\%$ | | test_dqn_speed | 2.1217ms | 1.4380ms | 695.4106 Ops/s | 690.7061 Ops/s | $\color{#35bf28}+0.68\\%$ | | test_ddpg_speed | 3.0293ms | 2.9042ms | 344.3294 Ops/s | 336.6384 Ops/s | $\color{#35bf28}+2.28\\%$ | | test_sac_speed | 95.0802ms | 9.0437ms | 110.5747 Ops/s | 119.1580 Ops/s | $\textbf{\color{#d91a1a}-7.20\\%}$ | | test_redq_speed | 11.1417ms | 10.5285ms | 94.9807 Ops/s | 85.8161 Ops/s | $\textbf{\color{#35bf28}+10.68\\%}$ | | test_redq_deprec_speed | 11.8519ms | 11.3943ms | 87.7634 Ops/s | 86.2866 Ops/s | $\color{#35bf28}+1.71\\%$ | | test_td3_speed | 8.5458ms | 8.2451ms | 121.2843 Ops/s | 120.1287 Ops/s | $\color{#35bf28}+0.96\\%$ | | test_cql_speed | 26.1822ms | 25.1804ms | 39.7134 Ops/s | 39.2253 Ops/s | $\color{#35bf28}+1.24\\%$ | | test_a2c_speed | 6.0699ms | 5.5884ms | 178.9433 Ops/s | 178.6894 Ops/s | $\color{#35bf28}+0.14\\%$ | | test_ppo_speed | 6.1529ms | 5.9312ms | 168.5993 Ops/s | 167.3637 Ops/s | $\color{#35bf28}+0.74\\%$ | | test_reinforce_speed | 4.7321ms | 4.5572ms | 219.4348 Ops/s | 217.3401 Ops/s | $\color{#35bf28}+0.96\\%$ | | test_iql_speed | 19.8513ms | 19.2924ms | 51.8338 Ops/s | 50.5667 Ops/s | $\color{#35bf28}+2.51\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 4.7422ms | 4.5166ms | 221.4060 Ops/s | 214.8376 Ops/s | $\color{#35bf28}+3.06\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.7626ms | 0.5859ms | 1.7069 KOps/s | 1.7058 KOps/s | $\color{#35bf28}+0.06\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 4.3026ms | 0.5656ms | 1.7682 KOps/s | 1.7761 KOps/s | $\color{#d91a1a}-0.45\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 4.6483ms | 4.4606ms | 224.1846 Ops/s | 217.0521 Ops/s | $\color{#35bf28}+3.29\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 0.6928ms | 0.5784ms | 1.7291 KOps/s | 1.7279 KOps/s | $\color{#35bf28}+0.07\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 4.4603ms | 0.5601ms | 1.7854 KOps/s | 1.7997 KOps/s | $\color{#d91a1a}-0.80\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] | 1.6657ms | 1.5358ms | 651.1450 Ops/s | 650.7363 Ops/s | $\color{#35bf28}+0.06\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] | 1.7075ms | 1.4589ms | 685.4593 Ops/s | 675.4981 Ops/s | $\color{#35bf28}+1.47\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 4.7315ms | 4.6153ms | 216.6720 Ops/s | 210.8333 Ops/s | $\color{#35bf28}+2.77\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 0.1339s | 0.8235ms | 1.2144 KOps/s | 1.1848 KOps/s | $\color{#35bf28}+2.49\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 0.8297ms | 0.6841ms | 1.4618 KOps/s | 1.4518 KOps/s | $\color{#35bf28}+0.69\\%$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 4.5875ms | 4.4975ms | 222.3461 Ops/s | 208.7388 Ops/s | $\textbf{\color{#35bf28}+6.52\\%}$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.7278ms | 0.5888ms | 1.6985 KOps/s | 1.6863 KOps/s | $\color{#35bf28}+0.72\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 4.6144ms | 0.5688ms | 1.7582 KOps/s | 1.7686 KOps/s | $\color{#d91a1a}-0.59\\%$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 4.6738ms | 4.5012ms | 222.1621 Ops/s | 217.0626 Ops/s | $\color{#35bf28}+2.35\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 0.8908ms | 0.5801ms | 1.7237 KOps/s | 1.7239 KOps/s | $\color{#d91a1a}-0.01\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.7429ms | 0.5577ms | 1.7931 KOps/s | 1.7676 KOps/s | $\color{#35bf28}+1.44\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 4.6961ms | 4.6175ms | 216.5692 Ops/s | 208.7961 Ops/s | $\color{#35bf28}+3.72\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 0.8884ms | 0.7134ms | 1.4018 KOps/s | 1.4034 KOps/s | $\color{#d91a1a}-0.12\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 4.8432ms | 0.6958ms | 1.4372 KOps/s | 1.4548 KOps/s | $\color{#d91a1a}-1.21\\%$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] | 0.1396s | 7.5307ms | 132.7900 Ops/s | 132.5404 Ops/s | $\color{#35bf28}+0.19\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] | 17.7178ms | 15.1432ms | 66.0362 Ops/s | 63.1445 Ops/s | $\color{#35bf28}+4.58\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] | 7.7040ms | 1.5071ms | 663.5396 Ops/s | 784.1347 Ops/s | $\textbf{\color{#d91a1a}-15.38\\%}$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] | 0.1188s | 9.4124ms | 106.2433 Ops/s | 105.2326 Ops/s | $\color{#35bf28}+0.96\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] | 17.5449ms | 15.2060ms | 65.7636 Ops/s | 63.8811 Ops/s | $\color{#35bf28}+2.95\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] | 2.3413ms | 1.3223ms | 756.2775 Ops/s | 709.5825 Ops/s | $\textbf{\color{#35bf28}+6.58\\%}$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] | 0.1181s | 7.4899ms | 133.5133 Ops/s | 130.2803 Ops/s | $\color{#35bf28}+2.48\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] | 17.7748ms | 15.3228ms | 65.2621 Ops/s | 63.1225 Ops/s | $\color{#35bf28}+3.39\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] | 2.7477ms | 1.6793ms | 595.4783 Ops/s | 593.5715 Ops/s | $\color{#35bf28}+0.32\\%$ |