search

pytorch / rl

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
https://pytorch.org/rl
MIT License
2.25k stars 297 forks source link

[Doc] Refactor README #2352

Closed vmoens closed 2 months ago

pytorch-bot[bot] commented 2 months ago

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2352

Note: Links to docs will display an error until the docs builds have been completed.

:x: 3 New Failures, 1 Cancelled Job, 16 Unrelated Failures

As of commit b57d37e1fc9a7781b7e3ea8a197bf284024c9f6f with merge base 3267533d9e1e45039de233145cb12369f3620d4b (image):

NEW FAILURES - The following jobs have failed:

* [Generate documentation / build-docs (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2352#28306158179) ([gh](https://github.com/pytorch/rl/actions/runs/10230864382/job/28306158179)) `No files were found with the provided path: /home/ec2-user/actions-runner/_work/_temp/artifacts/. No artifacts will be uploaded.` * [Unit-tests on Windows / unittests-cpu / windows-job](https://hud.pytorch.org/pr/pytorch/rl/2352#28306158065) ([gh](https://github.com/pytorch/rl/actions/runs/10230864387/job/28306158065)) `The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 128` * [Wheels / build-wheel-windows (3.11, 3.11)](https://hud.pytorch.org/pr/pytorch/rl/2352#28306173761) ([gh](https://github.com/pytorch/rl/actions/runs/10230864373/job/28306173761)) `Process completed with exit code 1.`

CANCELLED JOB - The following job was cancelled. Please retry:

* [Wheels / build-wheel-windows (3.12, 3.12)](https://hud.pytorch.org/pr/pytorch/rl/2352#28306173803) ([gh](https://github.com/pytorch/rl/actions/runs/10230864373/job/28306173803))

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

* [Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cpu](https://hud.pytorch.org/pr/pytorch/rl/2352#28316536688) ([gh](https://github.com/pytorch/rl/actions/runs/10230864397/job/28316536688)) ([similar failure](https://hud.pytorch.org/pytorch/rl/commit/b57d37e1fc9a7781b7e3ea8a197bf284024c9f6f#28316536752)) `Unable to find any artifacts for the associated workflow` * [Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cuda11_8](https://hud.pytorch.org/pr/pytorch/rl/2352#28316536752) ([gh](https://github.com/pytorch/rl/actions/runs/10230864397/job/28316536752)) ([similar failure](https://hud.pytorch.org/pytorch/rl/commit/b57d37e1fc9a7781b7e3ea8a197bf284024c9f6f#28316536910)) `Unable to find any artifacts for the associated workflow` * [Examples Tests on Linux / tests (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2352#28306158247) ([gh](https://github.com/pytorch/rl/actions/runs/10230864383/job/28306158247)) (matched **linux** rule in [flaky-rules.json](https://github.com/pytorch/test-infra/blob/generated-stats/stats/flaky-rules.json)) `The process '/usr/bin/git' failed with exit code 128` * [Habitat Tests on Linux / tests (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2352#28306158177) ([gh](https://github.com/pytorch/rl/actions/runs/10230864378/job/28306158177)) (matched **linux** rule in [flaky-rules.json](https://github.com/pytorch/test-infra/blob/generated-stats/stats/flaky-rules.json)) `The process '/usr/bin/git' failed with exit code 128` * [Libs Tests on Linux / unittests-gym (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2352#28306160151) ([gh](https://github.com/pytorch/rl/actions/runs/10230864380/job/28306160151)) (matched **linux** rule in [flaky-rules.json](https://github.com/pytorch/test-infra/blob/generated-stats/stats/flaky-rules.json)) `The process '/usr/bin/git' failed with exit code 128` * [Libs Tests on Linux / unittests-sklearn (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2352#28306160202) ([gh](https://github.com/pytorch/rl/actions/runs/10230864380/job/28306160202)) (matched **linux** rule in [flaky-rules.json](https://github.com/pytorch/test-infra/blob/generated-stats/stats/flaky-rules.json)) `The process '/usr/bin/git' failed with exit code 128` * [RLHF Tests on Linux / unittests (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2352#28306158476) ([gh](https://github.com/pytorch/rl/actions/runs/10230864391/job/28306158476)) (matched **linux** rule in [flaky-rules.json](https://github.com/pytorch/test-infra/blob/generated-stats/stats/flaky-rules.json)) `The process '/usr/bin/git' failed with exit code 128` * [Unit-tests on Linux / tests-gpu (3.11, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2352#28306159426) ([gh](https://github.com/pytorch/rl/actions/runs/10230864394/job/28306159426)) (matched **linux** rule in [flaky-rules.json](https://github.com/pytorch/test-infra/blob/generated-stats/stats/flaky-rules.json)) `The process '/usr/bin/git' failed with exit code 128` * [Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2352#28306159585) ([gh](https://github.com/pytorch/rl/actions/runs/10230864394/job/28306159585)) (matched **linux** rule in [flaky-rules.json](https://github.com/pytorch/test-infra/blob/generated-stats/stats/flaky-rules.json)) `The process '/usr/bin/git' failed with exit code 128` * [Unit-tests on Linux / tests-optdeps (3.10, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2352#28306159499) ([gh](https://github.com/pytorch/rl/actions/runs/10230864394/job/28306159499)) (matched **linux** rule in [flaky-rules.json](https://github.com/pytorch/test-infra/blob/generated-stats/stats/flaky-rules.json)) `The process '/usr/bin/git' failed with exit code 128` * [Unit-tests on Linux / tests-stable-gpu (3.10, 11.8) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2352#28306159673) ([gh](https://github.com/pytorch/rl/actions/runs/10230864394/job/28306159673)) (matched **linux** rule in [flaky-rules.json](https://github.com/pytorch/test-infra/blob/generated-stats/stats/flaky-rules.json)) `The process '/usr/bin/git' failed with exit code 128` * [Wheels / build-wheel-windows (3.10, 3.10.3)](https://hud.pytorch.org/pr/pytorch/rl/2352#28306173724) ([gh](https://github.com/pytorch/rl/actions/runs/10230864373/job/28306173724)) (matched **win** rule in [flaky-rules.json](https://github.com/pytorch/test-infra/blob/generated-stats/stats/flaky-rules.json)) `##[error]The operation was canceled.` * [Wheels / build-wheel-windows (3.8, 3.8)](https://hud.pytorch.org/pr/pytorch/rl/2352#28306173615) ([gh](https://github.com/pytorch/rl/actions/runs/10230864373/job/28306173615)) (matched **win** rule in [flaky-rules.json](https://github.com/pytorch/test-infra/blob/generated-stats/stats/flaky-rules.json)) `##[error]The operation was canceled.` * [Wheels / build-wheel-windows (3.9, 3.9)](https://hud.pytorch.org/pr/pytorch/rl/2352#28306173675) ([gh](https://github.com/pytorch/rl/actions/runs/10230864373/job/28306173675)) (matched **win** rule in [flaky-rules.json](https://github.com/pytorch/test-infra/blob/generated-stats/stats/flaky-rules.json)) `##[error]The operation was canceled.`

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

* [Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cuda12_1](https://hud.pytorch.org/pr/pytorch/rl/2352#28316536839) ([gh](https://github.com/pytorch/rl/actions/runs/10230864397/job/28316536839)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/3267533d9e1e45039de233145cb12369f3620d4b#28299615500)) `Unable to find any artifacts for the associated workflow` * [Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cuda12_4](https://hud.pytorch.org/pr/pytorch/rl/2352#28316536910) ([gh](https://github.com/pytorch/rl/actions/runs/10230864397/job/28316536910)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/3267533d9e1e45039de233145cb12369f3620d4b#28299615553)) `Unable to find any artifacts for the associated workflow`

This comment was automatically generated by Dr. CI and updates every 15 minutes.

github-actions[bot] commented 2 months ago

$\color{#D29922}\textsf{\Large\⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}1$. Worsened: $\large\color{#d91a1a}2$.

Expand to view detailed results | Name | Max | Mean | Ops | Ops on Repo `HEAD` | Change | | ----------------------------------------------------------------------------------------- | --------- | --------- | --------------- | ------------------ | ----------------------------------- | | test_single | 61.4793ms | 58.3034ms | 17.1517 Ops/s | 17.1134 Ops/s | $\color{#35bf28}+0.22\\%$ | | test_sync | 39.6389ms | 32.5362ms | 30.7350 Ops/s | 30.8949 Ops/s | $\color{#d91a1a}-0.52\\%$ | | test_async | 49.9269ms | 29.8765ms | 33.4711 Ops/s | 33.4082 Ops/s | $\color{#35bf28}+0.19\\%$ | | test_simple | 0.4789s | 0.4101s | 2.4382 Ops/s | 2.4054 Ops/s | $\color{#35bf28}+1.36\\%$ | | test_transformed | 0.6362s | 0.5702s | 1.7539 Ops/s | 1.7422 Ops/s | $\color{#35bf28}+0.67\\%$ | | test_serial | 1.3354s | 1.2741s | 0.7849 Ops/s | 0.7908 Ops/s | $\color{#d91a1a}-0.75\\%$ | | test_parallel | 1.1668s | 1.1073s | 0.9031 Ops/s | 0.9053 Ops/s | $\color{#d91a1a}-0.25\\%$ | | test_step_mdp_speed[True-True-True-True-True] | 0.1570ms | 24.1366μs | 41.4309 KOps/s | 40.9710 KOps/s | $\color{#35bf28}+1.12\\%$ | | test_step_mdp_speed[True-True-True-True-False] | 51.5670μs | 14.1590μs | 70.6264 KOps/s | 71.1578 KOps/s | $\color{#d91a1a}-0.75\\%$ | | test_step_mdp_speed[True-True-True-False-True] | 45.2440μs | 13.9588μs | 71.6396 KOps/s | 71.7641 KOps/s | $\color{#d91a1a}-0.17\\%$ | | test_step_mdp_speed[True-True-True-False-False] | 36.8890μs | 8.0882μs | 123.6371 KOps/s | 121.8560 KOps/s | $\color{#35bf28}+1.46\\%$ | | test_step_mdp_speed[True-True-False-True-True] | 58.7700μs | 25.4608μs | 39.2761 KOps/s | 38.3421 KOps/s | $\color{#35bf28}+2.44\\%$ | | test_step_mdp_speed[True-True-False-True-False] | 52.7490μs | 15.4931μs | 64.5449 KOps/s | 64.5553 KOps/s | $\color{#d91a1a}-0.02\\%$ | | test_step_mdp_speed[True-True-False-False-True] | 39.9450μs | 15.4796μs | 64.6013 KOps/s | 65.1314 KOps/s | $\color{#d91a1a}-0.81\\%$ | | test_step_mdp_speed[True-True-False-False-False] | 33.2530μs | 9.5368μs | 104.8566 KOps/s | 103.6496 KOps/s | $\color{#35bf28}+1.16\\%$ | | test_step_mdp_speed[True-False-True-True-True] | 55.9850μs | 27.1952μs | 36.7712 KOps/s | 36.5109 KOps/s | $\color{#35bf28}+0.71\\%$ | | test_step_mdp_speed[True-False-True-True-False] | 41.5180μs | 16.8610μs | 59.3085 KOps/s | 58.8646 KOps/s | $\color{#35bf28}+0.75\\%$ | | test_step_mdp_speed[True-False-True-False-True] | 49.5630μs | 15.3892μs | 64.9807 KOps/s | 65.5404 KOps/s | $\color{#d91a1a}-0.85\\%$ | | test_step_mdp_speed[True-False-True-False-False] | 46.4470μs | 9.5625μs | 104.5752 KOps/s | 104.4290 KOps/s | $\color{#35bf28}+0.14\\%$ | | test_step_mdp_speed[True-False-False-True-True] | 68.3580μs | 28.6127μs | 34.9495 KOps/s | 34.9714 KOps/s | $\color{#d91a1a}-0.06\\%$ | | test_step_mdp_speed[True-False-False-True-False] | 53.6600μs | 18.3806μs | 54.4052 KOps/s | 54.3226 KOps/s | $\color{#35bf28}+0.15\\%$ | | test_step_mdp_speed[True-False-False-False-True] | 41.3470μs | 16.8161μs | 59.4667 KOps/s | 60.0392 KOps/s | $\color{#d91a1a}-0.95\\%$ | | test_step_mdp_speed[True-False-False-False-False] | 36.3570μs | 10.8135μs | 92.4766 KOps/s | 90.6325 KOps/s | $\color{#35bf28}+2.03\\%$ | | test_step_mdp_speed[False-True-True-True-True] | 63.4490μs | 27.0455μs | 36.9748 KOps/s | 36.7818 KOps/s | $\color{#35bf28}+0.52\\%$ | | test_step_mdp_speed[False-True-True-True-False] | 50.6850μs | 17.1804μs | 58.2060 KOps/s | 58.1578 KOps/s | $\color{#35bf28}+0.08\\%$ | | test_step_mdp_speed[False-True-True-False-True] | 48.8210μs | 17.7564μs | 56.3179 KOps/s | 56.1663 KOps/s | $\color{#35bf28}+0.27\\%$ | | test_step_mdp_speed[False-True-True-False-False] | 59.7520μs | 10.7500μs | 93.0231 KOps/s | 92.3287 KOps/s | $\color{#35bf28}+0.75\\%$ | | test_step_mdp_speed[False-True-False-True-True] | 69.8510μs | 27.9940μs | 35.7220 KOps/s | 34.9763 KOps/s | $\color{#35bf28}+2.13\\%$ | | test_step_mdp_speed[False-True-False-True-False] | 86.4420μs | 18.2618μs | 54.7590 KOps/s | 53.5241 KOps/s | $\color{#35bf28}+2.31\\%$ | | test_step_mdp_speed[False-True-False-False-True] | 64.7010μs | 19.0354μs | 52.5336 KOps/s | 52.2374 KOps/s | $\color{#35bf28}+0.57\\%$ | | test_step_mdp_speed[False-True-False-False-False] | 58.2190μs | 12.0234μs | 83.1710 KOps/s | 81.1759 KOps/s | $\color{#35bf28}+2.46\\%$ | | test_step_mdp_speed[False-False-True-True-True] | 3.3588ms | 30.0890μs | 33.2347 KOps/s | 33.2355 KOps/s | $-0.00\\%$ | | test_step_mdp_speed[False-False-True-True-False] | 51.6760μs | 19.7968μs | 50.5131 KOps/s | 49.6400 KOps/s | $\color{#35bf28}+1.76\\%$ | | test_step_mdp_speed[False-False-True-False-True] | 68.3570μs | 19.1577μs | 52.1983 KOps/s | 51.8340 KOps/s | $\color{#35bf28}+0.70\\%$ | | test_step_mdp_speed[False-False-True-False-False] | 41.1070μs | 12.0742μs | 82.8211 KOps/s | 81.6698 KOps/s | $\color{#35bf28}+1.41\\%$ | | test_step_mdp_speed[False-False-False-True-True] | 72.7970μs | 31.1896μs | 32.0619 KOps/s | 31.9274 KOps/s | $\color{#35bf28}+0.42\\%$ | | test_step_mdp_speed[False-False-False-True-False] | 63.5290μs | 21.0088μs | 47.5991 KOps/s | 47.1521 KOps/s | $\color{#35bf28}+0.95\\%$ | | test_step_mdp_speed[False-False-False-False-True] | 53.8800μs | 20.0920μs | 49.7710 KOps/s | 49.2883 KOps/s | $\color{#35bf28}+0.98\\%$ | | test_step_mdp_speed[False-False-False-False-False] | 39.6840μs | 13.4015μs | 74.6186 KOps/s | 74.2076 KOps/s | $\color{#35bf28}+0.55\\%$ | | test_values[generalized_advantage_estimate-True-True] | 12.6752ms | 9.6820ms | 103.2842 Ops/s | 105.4923 Ops/s | $\color{#d91a1a}-2.09\\%$ | | test_values[vec_generalized_advantage_estimate-True-True] | 37.9572ms | 36.0501ms | 27.7392 Ops/s | 28.2218 Ops/s | $\color{#d91a1a}-1.71\\%$ | | test_values[td0_return_estimate-False-False] | 0.2289ms | 0.1629ms | 6.1398 KOps/s | 6.0490 KOps/s | $\color{#35bf28}+1.50\\%$ | | test_values[td1_return_estimate-False-False] | 24.2472ms | 23.7365ms | 42.1292 Ops/s | 42.3286 Ops/s | $\color{#d91a1a}-0.47\\%$ | | test_values[vec_td1_return_estimate-False-False] | 38.6068ms | 36.1796ms | 27.6399 Ops/s | 28.1828 Ops/s | $\color{#d91a1a}-1.93\\%$ | | test_values[td_lambda_return_estimate-True-False] | 37.5556ms | 34.4100ms | 29.0614 Ops/s | 29.3118 Ops/s | $\color{#d91a1a}-0.85\\%$ | | test_values[vec_td_lambda_return_estimate-True-False] | 37.5393ms | 36.2641ms | 27.5755 Ops/s | 28.0932 Ops/s | $\color{#d91a1a}-1.84\\%$ | | test_gae_speed[generalized_advantage_estimate-False-1-512] | 8.7448ms | 8.5149ms | 117.4405 Ops/s | 120.7320 Ops/s | $\color{#d91a1a}-2.73\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-True-1-512] | 2.3641ms | 1.9484ms | 513.2361 Ops/s | 522.5254 Ops/s | $\color{#d91a1a}-1.78\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-False-1-512] | 0.4348ms | 0.3613ms | 2.7675 KOps/s | 2.7825 KOps/s | $\color{#d91a1a}-0.54\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-True-32-512] | 48.3340ms | 47.2536ms | 21.1624 Ops/s | 21.1785 Ops/s | $\color{#d91a1a}-0.08\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-False-32-512] | 3.8911ms | 3.0405ms | 328.8894 Ops/s | 329.6086 Ops/s | $\color{#d91a1a}-0.22\\%$ | | test_dqn_speed | 6.2782ms | 1.3018ms | 768.1456 Ops/s | 781.1445 Ops/s | $\color{#d91a1a}-1.66\\%$ | | test_ddpg_speed | 3.5377ms | 2.7210ms | 367.5100 Ops/s | 373.5741 Ops/s | $\color{#d91a1a}-1.62\\%$ | | test_sac_speed | 8.5935ms | 8.0537ms | 124.1666 Ops/s | 127.0822 Ops/s | $\color{#d91a1a}-2.29\\%$ | | test_redq_speed | 14.4242ms | 12.6707ms | 78.9221 Ops/s | 79.4111 Ops/s | $\color{#d91a1a}-0.62\\%$ | | test_redq_deprec_speed | 14.4703ms | 12.7849ms | 78.2170 Ops/s | 79.8023 Ops/s | $\color{#d91a1a}-1.99\\%$ | | test_td3_speed | 8.2655ms | 7.9136ms | 126.3644 Ops/s | 128.7423 Ops/s | $\color{#d91a1a}-1.85\\%$ | | test_cql_speed | 36.6586ms | 35.2807ms | 28.3441 Ops/s | 28.1371 Ops/s | $\color{#35bf28}+0.74\\%$ | | test_a2c_speed | 8.7835ms | 7.2434ms | 138.0571 Ops/s | 138.7661 Ops/s | $\color{#d91a1a}-0.51\\%$ | | test_ppo_speed | 8.8379ms | 7.5230ms | 132.9263 Ops/s | 132.8572 Ops/s | $\color{#35bf28}+0.05\\%$ | | test_reinforce_speed | 7.5998ms | 6.4364ms | 155.3669 Ops/s | 156.2115 Ops/s | $\color{#d91a1a}-0.54\\%$ | | test_iql_speed | 33.2484ms | 31.8469ms | 31.4002 Ops/s | 31.5539 Ops/s | $\color{#d91a1a}-0.49\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 5.2329ms | 4.7442ms | 210.7858 Ops/s | 211.8949 Ops/s | $\color{#d91a1a}-0.52\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.8933ms | 0.4785ms | 2.0898 KOps/s | 2.1030 KOps/s | $\color{#d91a1a}-0.63\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.6677ms | 0.4504ms | 2.2205 KOps/s | 2.2114 KOps/s | $\color{#35bf28}+0.41\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 5.0919ms | 4.7299ms | 211.4225 Ops/s | 212.6292 Ops/s | $\color{#d91a1a}-0.57\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 0.8472ms | 0.4761ms | 2.1003 KOps/s | 2.1336 KOps/s | $\color{#d91a1a}-1.56\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.6131ms | 0.4458ms | 2.2429 KOps/s | 2.2313 KOps/s | $\color{#35bf28}+0.52\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] | 2.2152ms | 1.6946ms | 590.1240 Ops/s | 596.6913 Ops/s | $\color{#d91a1a}-1.10\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] | 2.1236ms | 1.6051ms | 623.0215 Ops/s | 630.4365 Ops/s | $\color{#d91a1a}-1.18\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 5.1342ms | 4.8859ms | 204.6695 Ops/s | 203.0940 Ops/s | $\color{#35bf28}+0.78\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 0.8208ms | 0.6176ms | 1.6193 KOps/s | 1.6301 KOps/s | $\color{#d91a1a}-0.66\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 0.9650ms | 0.5985ms | 1.6708 KOps/s | 1.6645 KOps/s | $\color{#35bf28}+0.38\\%$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 6.6043ms | 4.8698ms | 205.3479 Ops/s | 204.6226 Ops/s | $\color{#35bf28}+0.35\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.7587ms | 0.4886ms | 2.0466 KOps/s | 2.0882 KOps/s | $\color{#d91a1a}-1.99\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.6540ms | 0.4594ms | 2.1767 KOps/s | 2.2248 KOps/s | $\color{#d91a1a}-2.16\\%$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 5.1230ms | 4.7878ms | 208.8634 Ops/s | 212.2499 Ops/s | $\color{#d91a1a}-1.60\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 1.4477ms | 0.4806ms | 2.0809 KOps/s | 2.1153 KOps/s | $\color{#d91a1a}-1.63\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.6282ms | 0.4588ms | 2.1796 KOps/s | 2.2528 KOps/s | $\color{#d91a1a}-3.25\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 5.3936ms | 5.0925ms | 196.3690 Ops/s | 207.3025 Ops/s | $\textbf{\color{#d91a1a}-5.27\\%}$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 0.8471ms | 0.6243ms | 1.6017 KOps/s | 1.6418 KOps/s | $\color{#d91a1a}-2.44\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 7.1541ms | 0.6054ms | 1.6518 KOps/s | 1.7234 KOps/s | $\color{#d91a1a}-4.16\\%$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] | 0.1185s | 8.0124ms | 124.8065 Ops/s | 168.0489 Ops/s | $\textbf{\color{#d91a1a}-25.73\\%}$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] | 19.1972ms | 12.9925ms | 76.9677 Ops/s | 78.3135 Ops/s | $\color{#d91a1a}-1.72\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] | 1.6169ms | 1.0888ms | 918.4345 Ops/s | 882.0170 Ops/s | $\color{#35bf28}+4.13\\%$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] | 0.1050s | 5.8199ms | 171.8235 Ops/s | 174.9436 Ops/s | $\color{#d91a1a}-1.78\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] | 17.1438ms | 12.9158ms | 77.4244 Ops/s | 67.7448 Ops/s | $\textbf{\color{#35bf28}+14.29\\%}$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] | 1.8257ms | 1.0907ms | 916.8332 Ops/s | 902.5216 Ops/s | $\color{#35bf28}+1.59\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] | 0.1040s | 5.9231ms | 168.8297 Ops/s | 169.8225 Ops/s | $\color{#d91a1a}-0.58\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] | 17.3054ms | 13.0976ms | 76.3498 Ops/s | 77.8099 Ops/s | $\color{#d91a1a}-1.88\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] | 5.0945ms | 1.3201ms | 757.4966 Ops/s | 735.3512 Ops/s | $\color{#35bf28}+3.01\\%$ |
github-actions[bot] commented 2 months ago

$\color{#D29922}\textsf{\Large\⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}2$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results | Name | Max | Mean | Ops | Ops on Repo `HEAD` | Change | | ----------------------------------------------------------------------------------------- | --------- | --------- | -------------- | ------------------ | ----------------------------------- | | test_single | 0.1079s | 0.1052s | 9.5068 Ops/s | 9.3891 Ops/s | $\color{#35bf28}+1.25\\%$ | | test_sync | 99.9030ms | 94.0954ms | 10.6275 Ops/s | 10.9858 Ops/s | $\color{#d91a1a}-3.26\\%$ | | test_async | 0.2591s | 90.6651ms | 11.0296 Ops/s | 11.5188 Ops/s | $\color{#d91a1a}-4.25\\%$ | | test_single_pixels | 0.1154s | 0.1153s | 8.6750 Ops/s | 8.5640 Ops/s | $\color{#35bf28}+1.30\\%$ | | test_sync_pixels | 76.8005ms | 75.1216ms | 13.3118 Ops/s | 13.1358 Ops/s | $\color{#35bf28}+1.34\\%$ | | test_async_pixels | 0.1423s | 70.4103ms | 14.2025 Ops/s | 14.1502 Ops/s | $\color{#35bf28}+0.37\\%$ | | test_simple | 0.7757s | 0.7563s | 1.3223 Ops/s | 1.2822 Ops/s | $\color{#35bf28}+3.13\\%$ | | test_transformed | 1.0711s | 0.9979s | 1.0021 Ops/s | 1.0063 Ops/s | $\color{#d91a1a}-0.41\\%$ | | test_serial | 2.2499s | 2.1716s | 0.4605 Ops/s | 0.4572 Ops/s | $\color{#35bf28}+0.72\\%$ | | test_parallel | 1.9325s | 1.8771s | 0.5327 Ops/s | 0.5289 Ops/s | $\color{#35bf28}+0.73\\%$ | | test_step_mdp_speed[True-True-True-True-True] | 0.1108ms | 35.5889μs | 28.0986 KOps/s | 27.2134 KOps/s | $\color{#35bf28}+3.25\\%$ | | test_step_mdp_speed[True-True-True-True-False] | 36.0310μs | 20.2480μs | 49.3877 KOps/s | 47.7944 KOps/s | $\color{#35bf28}+3.33\\%$ | | test_step_mdp_speed[True-True-True-False-True] | 36.0010μs | 19.9415μs | 50.1468 KOps/s | 48.2532 KOps/s | $\color{#35bf28}+3.92\\%$ | | test_step_mdp_speed[True-True-True-False-False] | 30.9100μs | 11.6368μs | 85.9340 KOps/s | 84.8552 KOps/s | $\color{#35bf28}+1.27\\%$ | | test_step_mdp_speed[True-True-False-True-True] | 65.5010μs | 37.6135μs | 26.5862 KOps/s | 25.7603 KOps/s | $\color{#35bf28}+3.21\\%$ | | test_step_mdp_speed[True-True-False-True-False] | 37.6110μs | 22.2534μs | 44.9370 KOps/s | 43.4568 KOps/s | $\color{#35bf28}+3.41\\%$ | | test_step_mdp_speed[True-True-False-False-True] | 39.9210μs | 22.4513μs | 44.5409 KOps/s | 44.5199 KOps/s | $\color{#35bf28}+0.05\\%$ | | test_step_mdp_speed[True-True-False-False-False] | 52.3810μs | 13.8278μs | 72.3180 KOps/s | 71.6641 KOps/s | $\color{#35bf28}+0.91\\%$ | | test_step_mdp_speed[True-False-True-True-True] | 73.7410μs | 40.3706μs | 24.7705 KOps/s | 24.5162 KOps/s | $\color{#35bf28}+1.04\\%$ | | test_step_mdp_speed[True-False-True-True-False] | 50.3810μs | 24.7312μs | 40.4347 KOps/s | 39.6764 KOps/s | $\color{#35bf28}+1.91\\%$ | | test_step_mdp_speed[True-False-True-False-True] | 37.2700μs | 21.7319μs | 46.0154 KOps/s | 44.7653 KOps/s | $\color{#35bf28}+2.79\\%$ | | test_step_mdp_speed[True-False-True-False-False] | 37.6300μs | 13.5304μs | 73.9076 KOps/s | 72.3471 KOps/s | $\color{#35bf28}+2.16\\%$ | | test_step_mdp_speed[True-False-False-True-True] | 59.3900μs | 41.3288μs | 24.1962 KOps/s | 23.7353 KOps/s | $\color{#35bf28}+1.94\\%$ | | test_step_mdp_speed[True-False-False-True-False] | 42.5410μs | 26.4453μs | 37.8139 KOps/s | 36.7814 KOps/s | $\color{#35bf28}+2.81\\%$ | | test_step_mdp_speed[True-False-False-False-True] | 43.4100μs | 23.9943μs | 41.6766 KOps/s | 40.9456 KOps/s | $\color{#35bf28}+1.79\\%$ | | test_step_mdp_speed[True-False-False-False-False] | 52.9300μs | 15.6265μs | 63.9940 KOps/s | 62.3188 KOps/s | $\color{#35bf28}+2.69\\%$ | | test_step_mdp_speed[False-True-True-True-True] | 58.2300μs | 39.5688μs | 25.2725 KOps/s | 24.5599 KOps/s | $\color{#35bf28}+2.90\\%$ | | test_step_mdp_speed[False-True-True-True-False] | 43.5800μs | 24.6222μs | 40.6138 KOps/s | 39.3032 KOps/s | $\color{#35bf28}+3.33\\%$ | | test_step_mdp_speed[False-True-True-False-True] | 47.7310μs | 26.5390μs | 37.6803 KOps/s | 36.8957 KOps/s | $\color{#35bf28}+2.13\\%$ | | test_step_mdp_speed[False-True-True-False-False] | 32.8700μs | 15.5926μs | 64.1330 KOps/s | 62.7376 KOps/s | $\color{#35bf28}+2.22\\%$ | | test_step_mdp_speed[False-True-False-True-True] | 65.9810μs | 41.1964μs | 24.2740 KOps/s | 23.3974 KOps/s | $\color{#35bf28}+3.75\\%$ | | test_step_mdp_speed[False-True-False-True-False] | 43.9410μs | 26.8132μs | 37.2951 KOps/s | 36.8671 KOps/s | $\color{#35bf28}+1.16\\%$ | | test_step_mdp_speed[False-True-False-False-True] | 57.8900μs | 28.0184μs | 35.6908 KOps/s | 34.4841 KOps/s | $\color{#35bf28}+3.50\\%$ | | test_step_mdp_speed[False-True-False-False-False] | 41.5400μs | 17.5825μs | 56.8747 KOps/s | 55.7521 KOps/s | $\color{#35bf28}+2.01\\%$ | | test_step_mdp_speed[False-False-True-True-True] | 4.1603ms | 44.9014μs | 22.2710 KOps/s | 21.9193 KOps/s | $\color{#35bf28}+1.60\\%$ | | test_step_mdp_speed[False-False-True-True-False] | 55.1610μs | 28.9736μs | 34.5142 KOps/s | 33.5722 KOps/s | $\color{#35bf28}+2.81\\%$ | | test_step_mdp_speed[False-False-True-False-True] | 51.8310μs | 28.3158μs | 35.3159 KOps/s | 34.6260 KOps/s | $\color{#35bf28}+1.99\\%$ | | test_step_mdp_speed[False-False-True-False-False] | 31.8400μs | 17.6670μs | 56.6026 KOps/s | 54.9238 KOps/s | $\color{#35bf28}+3.06\\%$ | | test_step_mdp_speed[False-False-False-True-True] | 65.1410μs | 45.4078μs | 22.0227 KOps/s | 21.3488 KOps/s | $\color{#35bf28}+3.16\\%$ | | test_step_mdp_speed[False-False-False-True-False] | 54.4410μs | 30.7965μs | 32.4712 KOps/s | 31.3683 KOps/s | $\color{#35bf28}+3.52\\%$ | | test_step_mdp_speed[False-False-False-False-True] | 54.0910μs | 29.7832μs | 33.5760 KOps/s | 32.9740 KOps/s | $\color{#35bf28}+1.83\\%$ | | test_step_mdp_speed[False-False-False-False-False] | 35.1610μs | 19.3598μs | 51.6535 KOps/s | 50.9407 KOps/s | $\color{#35bf28}+1.40\\%$ | | test_values[generalized_advantage_estimate-True-True] | 25.1249ms | 24.5825ms | 40.6793 Ops/s | 40.8691 Ops/s | $\color{#d91a1a}-0.46\\%$ | | test_values[vec_generalized_advantage_estimate-True-True] | 88.5638ms | 2.6731ms | 374.0992 Ops/s | 372.1432 Ops/s | $\color{#35bf28}+0.53\\%$ | | test_values[td0_return_estimate-False-False] | 90.4920μs | 66.6219μs | 15.0101 KOps/s | 14.9524 KOps/s | $\color{#35bf28}+0.39\\%$ | | test_values[td1_return_estimate-False-False] | 55.6029ms | 55.1906ms | 18.1190 Ops/s | 18.1717 Ops/s | $\color{#d91a1a}-0.29\\%$ | | test_values[vec_td1_return_estimate-False-False] | 1.3806ms | 1.0930ms | 914.8747 Ops/s | 916.2671 Ops/s | $\color{#d91a1a}-0.15\\%$ | | test_values[td_lambda_return_estimate-True-False] | 88.7287ms | 87.9921ms | 11.3647 Ops/s | 11.4557 Ops/s | $\color{#d91a1a}-0.79\\%$ | | test_values[vec_td_lambda_return_estimate-True-False] | 1.4060ms | 1.0912ms | 916.4357 Ops/s | 917.4829 Ops/s | $\color{#d91a1a}-0.11\\%$ | | test_gae_speed[generalized_advantage_estimate-False-1-512] | 24.7865ms | 24.6477ms | 40.5717 Ops/s | 40.7922 Ops/s | $\color{#d91a1a}-0.54\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-True-1-512] | 0.9454ms | 0.7254ms | 1.3786 KOps/s | 1.3800 KOps/s | $\color{#d91a1a}-0.10\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-False-1-512] | 0.7640ms | 0.6771ms | 1.4769 KOps/s | 1.4808 KOps/s | $\color{#d91a1a}-0.26\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-True-32-512] | 1.4993ms | 1.4720ms | 679.3357 Ops/s | 680.2511 Ops/s | $\color{#d91a1a}-0.13\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-False-32-512] | 0.7367ms | 0.6934ms | 1.4421 KOps/s | 1.4479 KOps/s | $\color{#d91a1a}-0.40\\%$ | | test_dqn_speed | 7.3853ms | 1.3417ms | 745.3081 Ops/s | 736.9243 Ops/s | $\color{#35bf28}+1.14\\%$ | | test_ddpg_speed | 3.1479ms | 2.7044ms | 369.7743 Ops/s | 363.2884 Ops/s | $\color{#35bf28}+1.79\\%$ | | test_sac_speed | 8.3652ms | 7.7973ms | 128.2495 Ops/s | 126.0259 Ops/s | $\color{#35bf28}+1.76\\%$ | | test_redq_speed | 11.0032ms | 9.9333ms | 100.6718 Ops/s | 98.0889 Ops/s | $\color{#35bf28}+2.63\\%$ | | test_redq_deprec_speed | 10.8552ms | 10.5748ms | 94.5643 Ops/s | 91.6284 Ops/s | $\color{#35bf28}+3.20\\%$ | | test_td3_speed | 8.1705ms | 7.7572ms | 128.9126 Ops/s | 127.2044 Ops/s | $\color{#35bf28}+1.34\\%$ | | test_cql_speed | 25.3050ms | 24.5748ms | 40.6921 Ops/s | 39.9612 Ops/s | $\color{#35bf28}+1.83\\%$ | | test_a2c_speed | 5.6774ms | 5.4316ms | 184.1090 Ops/s | 179.3956 Ops/s | $\color{#35bf28}+2.63\\%$ | | test_ppo_speed | 6.1044ms | 5.7633ms | 173.5130 Ops/s | 170.0836 Ops/s | $\color{#35bf28}+2.02\\%$ | | test_reinforce_speed | 4.5507ms | 4.4085ms | 226.8367 Ops/s | 219.6577 Ops/s | $\color{#35bf28}+3.27\\%$ | | test_iql_speed | 19.8614ms | 19.2946ms | 51.8280 Ops/s | 51.2146 Ops/s | $\color{#35bf28}+1.20\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 6.6154ms | 6.5190ms | 153.3976 Ops/s | 150.6579 Ops/s | $\color{#35bf28}+1.82\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.8243ms | 0.5108ms | 1.9576 KOps/s | 1.9405 KOps/s | $\color{#35bf28}+0.88\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.6799ms | 0.4901ms | 2.0405 KOps/s | 2.0210 KOps/s | $\color{#35bf28}+0.96\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 6.6483ms | 6.4114ms | 155.9713 Ops/s | 153.2192 Ops/s | $\color{#35bf28}+1.80\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 1.7494ms | 0.5048ms | 1.9810 KOps/s | 1.9619 KOps/s | $\color{#35bf28}+0.98\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.6496ms | 0.4867ms | 2.0547 KOps/s | 2.0518 KOps/s | $\color{#35bf28}+0.14\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] | 2.0764ms | 1.9540ms | 511.7739 Ops/s | 504.5256 Ops/s | $\color{#35bf28}+1.44\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] | 2.0710ms | 1.8618ms | 537.1229 Ops/s | 526.6468 Ops/s | $\color{#35bf28}+1.99\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 6.8327ms | 6.6869ms | 149.5468 Ops/s | 147.2535 Ops/s | $\color{#35bf28}+1.56\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 1.1247ms | 0.6692ms | 1.4943 KOps/s | 1.5001 KOps/s | $\color{#d91a1a}-0.39\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 1.5459ms | 0.7185ms | 1.3918 KOps/s | 1.5571 KOps/s | $\textbf{\color{#d91a1a}-10.61\\%}$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 6.5784ms | 6.5245ms | 153.2680 Ops/s | 149.8076 Ops/s | $\color{#35bf28}+2.31\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.9888ms | 0.5096ms | 1.9622 KOps/s | 1.9346 KOps/s | $\color{#35bf28}+1.43\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.7511ms | 0.4883ms | 2.0478 KOps/s | 2.0225 KOps/s | $\color{#35bf28}+1.25\\%$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 6.6975ms | 6.4392ms | 155.2985 Ops/s | 152.1080 Ops/s | $\color{#35bf28}+2.10\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 0.1245s | 0.6752ms | 1.4811 KOps/s | 1.9496 KOps/s | $\textbf{\color{#d91a1a}-24.03\\%}$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.7527ms | 0.4835ms | 2.0684 KOps/s | 2.0077 KOps/s | $\color{#35bf28}+3.02\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 6.7877ms | 6.6849ms | 149.5910 Ops/s | 146.6196 Ops/s | $\color{#35bf28}+2.03\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 0.7889ms | 0.6593ms | 1.5168 KOps/s | 1.2151 KOps/s | $\textbf{\color{#35bf28}+24.83\\%}$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 4.4580ms | 0.6429ms | 1.5555 KOps/s | 1.5581 KOps/s | $\color{#d91a1a}-0.16\\%$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] | 0.1287s | 7.5899ms | 131.7542 Ops/s | 131.9884 Ops/s | $\color{#d91a1a}-0.18\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] | 18.2366ms | 15.7929ms | 63.3196 Ops/s | 61.2395 Ops/s | $\color{#35bf28}+3.40\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] | 2.1723ms | 1.2353ms | 809.5457 Ops/s | 769.2577 Ops/s | $\textbf{\color{#35bf28}+5.24\\%}$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] | 0.1235s | 7.5125ms | 133.1114 Ops/s | 131.9154 Ops/s | $\color{#35bf28}+0.91\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] | 0.1359s | 18.5754ms | 53.8348 Ops/s | 61.6261 Ops/s | $\textbf{\color{#d91a1a}-12.64\\%}$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] | 7.0002ms | 1.3570ms | 736.8956 Ops/s | 791.6871 Ops/s | $\textbf{\color{#d91a1a}-6.92\\%}$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] | 0.1236s | 7.7450ms | 129.1164 Ops/s | 129.0911 Ops/s | $\color{#35bf28}+0.02\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] | 19.3862ms | 16.6767ms | 59.9640 Ops/s | 60.0722 Ops/s | $\color{#d91a1a}-0.18\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] | 7.4298ms | 1.5010ms | 666.2299 Ops/s | 686.4697 Ops/s | $\color{#d91a1a}-2.95\\%$ |