search

pytorch / rl

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
https://pytorch.org/rl
MIT License
2.01k stars 269 forks source link

[CI] Bump jinja2 from 3.1.3 to 3.1.4 in /docs #2250

Closed dependabot[bot] closed 2 weeks ago

dependabot[bot] commented 2 weeks ago

Bumps jinja2 from 3.1.3 to 3.1.4.

Release notes

Sourced from jinja2's releases.

3.1.4

This is the Jinja 3.1.4 security release, which fixes security issues and bugs but does not otherwise change behavior and should not result in breaking changes.

PyPI: https://pypi.org/project/Jinja2/3.1.4/ Changes: https://jinja.palletsprojects.com/en/3.1.x/changes/#version-3-1-4

  • The xmlattr filter does not allow keys with / solidus, > greater-than sign, or = equals sign, in addition to disallowing spaces. Regardless of any validation done by Jinja, user input should never be used as keys to this filter, or must be separately validated first. GHSA-h75v-3vvj-5mfj
Changelog

Sourced from jinja2's changelog.

Version 3.1.4

Released 2024-05-05

  • The xmlattr filter does not allow keys with / solidus, > greater-than sign, or = equals sign, in addition to disallowing spaces. Regardless of any validation done by Jinja, user input should never be used as keys to this filter, or must be separately validated first. :ghsa:h75v-3vvj-5mfj
Commits


Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/pytorch/rl/network/alerts).
pytorch-bot[bot] commented 2 weeks ago

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2250

Note: Links to docs will display an error until the docs builds have been completed.

:x: 4 New Failures, 1 Unrelated Failure

As of commit b5428793fa5fd827f4f7a7e3bc96eb56fe1759da with merge base 559b729c30a20aeea67a9ed6981a31e2512936f6 (image):

NEW FAILURES - The following jobs have failed:

* [Habitat Tests on Linux / tests (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2250#26701429997) ([gh](https://github.com/pytorch/rl/actions/runs/9678198184/job/26701429997)) `RuntimeError: Command docker exec -t 9e86830f38400d6250809bf2d02aba1b12da09bcd19016dbab5163641f1de223 /exec failed with exit code 139` * [Libs Tests on Linux / unittests-gym (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2250#26701436041) ([gh](https://github.com/pytorch/rl/actions/runs/9678198186/job/26701436041)) `RuntimeError: Command docker exec -t 204a312e978d964a9cf8b8670e5d4e46c5d9236a885c80eb8cfa38345ed022a6 /exec failed with exit code 1` * [Unit-tests on Linux / tests-optdeps (3.10, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2250#26701433753) ([gh](https://github.com/pytorch/rl/actions/runs/9678198159/job/26701433753)) `RuntimeError: Command docker exec -t dc298f4d740cd31b4d01e480cb575e43a5050cb6bc108e38ac00263f7ab00f95 /exec failed with exit code 1` * [Unit-tests on Windows / unittests-cpu / windows-job](https://hud.pytorch.org/pr/pytorch/rl/2250#26701428948) ([gh](https://github.com/pytorch/rl/actions/runs/9678198179/job/26701428948)) `The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 128`

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

* [Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2250#26701433338) ([gh](https://github.com/pytorch/rl/actions/runs/9678198159/job/26701433338)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/559b729c30a20aeea67a9ed6981a31e2512936f6#26692654497)) `AttributeError: module 'torch' has no attribute 'uint16'`

This comment was automatically generated by Dr. CI and updates every 15 minutes.

github-actions[bot] commented 2 weeks ago

$\color{#D29922}\textsf{\Large\⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}0$. Worsened: $\large\color{#d91a1a}7$.

Expand to view detailed results | Name | Max | Mean | Ops | Ops on Repo `HEAD` | Change | | ----------------------------------------------------------------------------------------- | --------- | --------- | --------------- | ------------------ | ---------------------------------- | | test_single | 0.1144s | 60.4440ms | 16.5442 Ops/s | 17.6928 Ops/s | $\textbf{\color{#d91a1a}-6.49\\%}$ | | test_sync | 40.6320ms | 31.8698ms | 31.3777 Ops/s | 31.9427 Ops/s | $\color{#d91a1a}-1.77\\%$ | | test_async | 66.9109ms | 28.4744ms | 35.1193 Ops/s | 34.8968 Ops/s | $\color{#35bf28}+0.64\\%$ | | test_simple | 0.3797s | 0.3783s | 2.6437 Ops/s | 2.6307 Ops/s | $\color{#35bf28}+0.49\\%$ | | test_transformed | 0.5398s | 0.5392s | 1.8544 Ops/s | 1.8460 Ops/s | $\color{#35bf28}+0.46\\%$ | | test_serial | 1.3320s | 1.2839s | 0.7789 Ops/s | 0.7811 Ops/s | $\color{#d91a1a}-0.28\\%$ | | test_parallel | 1.1447s | 1.0810s | 0.9250 Ops/s | 0.9255 Ops/s | $\color{#d91a1a}-0.05\\%$ | | test_step_mdp_speed[True-True-True-True-True] | 0.1521ms | 22.8204μs | 43.8205 KOps/s | 43.7393 KOps/s | $\color{#35bf28}+0.19\\%$ | | test_step_mdp_speed[True-True-True-True-False] | 41.3470μs | 13.3089μs | 75.1375 KOps/s | 75.7810 KOps/s | $\color{#d91a1a}-0.85\\%$ | | test_step_mdp_speed[True-True-True-False-True] | 44.0720μs | 13.3984μs | 74.6358 KOps/s | 75.3188 KOps/s | $\color{#d91a1a}-0.91\\%$ | | test_step_mdp_speed[True-True-True-False-False] | 41.2670μs | 7.8057μs | 128.1118 KOps/s | 130.3199 KOps/s | $\color{#d91a1a}-1.69\\%$ | | test_step_mdp_speed[True-True-False-True-True] | 70.7320μs | 24.0072μs | 41.6542 KOps/s | 41.7865 KOps/s | $\color{#d91a1a}-0.32\\%$ | | test_step_mdp_speed[True-True-False-True-False] | 58.9400μs | 14.6708μs | 68.1628 KOps/s | 69.6359 KOps/s | $\color{#d91a1a}-2.12\\%$ | | test_step_mdp_speed[True-True-False-False-True] | 54.5510μs | 14.6317μs | 68.3448 KOps/s | 69.0900 KOps/s | $\color{#d91a1a}-1.08\\%$ | | test_step_mdp_speed[True-True-False-False-False] | 25.3070μs | 9.1549μs | 109.2316 KOps/s | 110.9243 KOps/s | $\color{#d91a1a}-1.53\\%$ | | test_step_mdp_speed[True-False-True-True-True] | 66.3440μs | 25.4564μs | 39.2828 KOps/s | 39.4239 KOps/s | $\color{#d91a1a}-0.36\\%$ | | test_step_mdp_speed[True-False-True-True-False] | 57.9480μs | 15.8572μs | 63.0630 KOps/s | 63.0261 KOps/s | $\color{#35bf28}+0.06\\%$ | | test_step_mdp_speed[True-False-True-False-True] | 51.2550μs | 14.6937μs | 68.0562 KOps/s | 69.0762 KOps/s | $\color{#d91a1a}-1.48\\%$ | | test_step_mdp_speed[True-False-True-False-False] | 27.7420μs | 9.0834μs | 110.0915 KOps/s | 110.3823 KOps/s | $\color{#d91a1a}-0.26\\%$ | | test_step_mdp_speed[True-False-False-True-True] | 0.1004ms | 26.4042μs | 37.8728 KOps/s | 38.0883 KOps/s | $\color{#d91a1a}-0.57\\%$ | | test_step_mdp_speed[True-False-False-True-False] | 61.9460μs | 17.1276μs | 58.3855 KOps/s | 59.3983 KOps/s | $\color{#d91a1a}-1.71\\%$ | | test_step_mdp_speed[True-False-False-False-True] | 35.9770μs | 15.8504μs | 63.0897 KOps/s | 64.3744 KOps/s | $\color{#d91a1a}-2.00\\%$ | | test_step_mdp_speed[True-False-False-False-False] | 54.4810μs | 10.2901μs | 97.1811 KOps/s | 99.1247 KOps/s | $\color{#d91a1a}-1.96\\%$ | | test_step_mdp_speed[False-True-True-True-True] | 65.1820μs | 26.0089μs | 38.4483 KOps/s | 39.5743 KOps/s | $\color{#d91a1a}-2.85\\%$ | | test_step_mdp_speed[False-True-True-True-False] | 63.6090μs | 15.8515μs | 63.0853 KOps/s | 63.4168 KOps/s | $\color{#d91a1a}-0.52\\%$ | | test_step_mdp_speed[False-True-True-False-True] | 65.9230μs | 16.9341μs | 59.0526 KOps/s | 59.9016 KOps/s | $\color{#d91a1a}-1.42\\%$ | | test_step_mdp_speed[False-True-True-False-False] | 37.1990μs | 10.3099μs | 96.9941 KOps/s | 97.8240 KOps/s | $\color{#d91a1a}-0.85\\%$ | | test_step_mdp_speed[False-True-False-True-True] | 72.0340μs | 26.8437μs | 37.2527 KOps/s | 37.9582 KOps/s | $\color{#d91a1a}-1.86\\%$ | | test_step_mdp_speed[False-True-False-True-False] | 37.7810μs | 17.0235μs | 58.7423 KOps/s | 58.9962 KOps/s | $\color{#d91a1a}-0.43\\%$ | | test_step_mdp_speed[False-True-False-False-True] | 65.2920μs | 18.0251μs | 55.4783 KOps/s | 55.9298 KOps/s | $\color{#d91a1a}-0.81\\%$ | | test_step_mdp_speed[False-True-False-False-False] | 32.3410μs | 11.4438μs | 87.3839 KOps/s | 88.4178 KOps/s | $\color{#d91a1a}-1.17\\%$ | | test_step_mdp_speed[False-False-True-True-True] | 75.7620μs | 27.9225μs | 35.8134 KOps/s | 35.9408 KOps/s | $\color{#d91a1a}-0.35\\%$ | | test_step_mdp_speed[False-False-True-True-False] | 61.8460μs | 18.4023μs | 54.3410 KOps/s | 54.3452 KOps/s | $-0.01\\%$ | | test_step_mdp_speed[False-False-True-False-True] | 50.0740μs | 18.2011μs | 54.9419 KOps/s | 55.8931 KOps/s | $\color{#d91a1a}-1.70\\%$ | | test_step_mdp_speed[False-False-True-False-False] | 46.7770μs | 11.8452μs | 84.4222 KOps/s | 87.5931 KOps/s | $\color{#d91a1a}-3.62\\%$ | | test_step_mdp_speed[False-False-False-True-True] | 50.9850μs | 29.7503μs | 33.6131 KOps/s | 34.3550 KOps/s | $\color{#d91a1a}-2.16\\%$ | | test_step_mdp_speed[False-False-False-True-False] | 48.9910μs | 20.7801μs | 48.1229 KOps/s | 51.1940 KOps/s | $\textbf{\color{#d91a1a}-6.00\\%}$ | | test_step_mdp_speed[False-False-False-False-True] | 62.6270μs | 19.2316μs | 51.9977 KOps/s | 53.5342 KOps/s | $\color{#d91a1a}-2.87\\%$ | | test_step_mdp_speed[False-False-False-False-False] | 47.2780μs | 13.2364μs | 75.5491 KOps/s | 80.7571 KOps/s | $\textbf{\color{#d91a1a}-6.45\\%}$ | | test_values[generalized_advantage_estimate-True-True] | 9.6339ms | 9.3636ms | 106.7966 Ops/s | 104.2843 Ops/s | $\color{#35bf28}+2.41\\%$ | | test_values[vec_generalized_advantage_estimate-True-True] | 37.4723ms | 35.1844ms | 28.4217 Ops/s | 30.2141 Ops/s | $\textbf{\color{#d91a1a}-5.93\\%}$ | | test_values[td0_return_estimate-False-False] | 0.2260ms | 0.1629ms | 6.1380 KOps/s | 5.8802 KOps/s | $\color{#35bf28}+4.38\\%$ | | test_values[td1_return_estimate-False-False] | 26.1596ms | 24.0413ms | 41.5951 Ops/s | 41.3633 Ops/s | $\color{#35bf28}+0.56\\%$ | | test_values[vec_td1_return_estimate-False-False] | 37.2454ms | 35.4020ms | 28.2470 Ops/s | 28.6766 Ops/s | $\color{#d91a1a}-1.50\\%$ | | test_values[td_lambda_return_estimate-True-False] | 37.3171ms | 34.1378ms | 29.2930 Ops/s | 28.6866 Ops/s | $\color{#35bf28}+2.11\\%$ | | test_values[vec_td_lambda_return_estimate-True-False] | 41.3558ms | 35.5327ms | 28.1431 Ops/s | 29.4816 Ops/s | $\color{#d91a1a}-4.54\\%$ | | test_gae_speed[generalized_advantage_estimate-False-1-512] | 8.4903ms | 8.3099ms | 120.3378 Ops/s | 119.1603 Ops/s | $\color{#35bf28}+0.99\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-True-1-512] | 4.2616ms | 2.0128ms | 496.8247 Ops/s | 482.2121 Ops/s | $\color{#35bf28}+3.03\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-False-1-512] | 0.5923ms | 0.3622ms | 2.7607 KOps/s | 2.7452 KOps/s | $\color{#35bf28}+0.57\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-True-32-512] | 46.3801ms | 45.6388ms | 21.9112 Ops/s | 23.9026 Ops/s | $\textbf{\color{#d91a1a}-8.33\\%}$ | | test_gae_speed[vec_generalized_advantage_estimate-False-32-512] | 3.1177ms | 3.0344ms | 329.5598 Ops/s | 316.8923 Ops/s | $\color{#35bf28}+4.00\\%$ | | test_dqn_speed | 6.7355ms | 1.3784ms | 725.4999 Ops/s | 731.5536 Ops/s | $\color{#d91a1a}-0.83\\%$ | | test_ddpg_speed | 3.7092ms | 2.9019ms | 344.6037 Ops/s | 344.5782 Ops/s | $+0.01\\%$ | | test_sac_speed | 9.3430ms | 8.5922ms | 116.3849 Ops/s | 115.1705 Ops/s | $\color{#35bf28}+1.05\\%$ | | test_redq_speed | 95.0517ms | 14.6613ms | 68.2068 Ops/s | 73.8060 Ops/s | $\textbf{\color{#d91a1a}-7.59\\%}$ | | test_redq_deprec_speed | 17.9394ms | 13.8733ms | 72.0808 Ops/s | 74.2437 Ops/s | $\color{#d91a1a}-2.91\\%$ | | test_td3_speed | 10.1431ms | 8.5347ms | 117.1683 Ops/s | 115.6454 Ops/s | $\color{#35bf28}+1.32\\%$ | | test_cql_speed | 38.6654ms | 36.7285ms | 27.2268 Ops/s | 27.0042 Ops/s | $\color{#35bf28}+0.82\\%$ | | test_a2c_speed | 8.3246ms | 7.5147ms | 133.0717 Ops/s | 132.9956 Ops/s | $\color{#35bf28}+0.06\\%$ | | test_ppo_speed | 9.7325ms | 7.8039ms | 128.1408 Ops/s | 128.3250 Ops/s | $\color{#d91a1a}-0.14\\%$ | | test_reinforce_speed | 8.0756ms | 6.6740ms | 149.8342 Ops/s | 149.0883 Ops/s | $\color{#35bf28}+0.50\\%$ | | test_iql_speed | 34.0662ms | 32.7597ms | 30.5253 Ops/s | 30.1465 Ops/s | $\color{#35bf28}+1.26\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 5.4089ms | 3.4523ms | 289.6592 Ops/s | 293.7307 Ops/s | $\color{#d91a1a}-1.39\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 93.4552ms | 0.5554ms | 1.8006 KOps/s | 1.7838 KOps/s | $\color{#35bf28}+0.94\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.8524ms | 0.4659ms | 2.1464 KOps/s | 2.1155 KOps/s | $\color{#35bf28}+1.46\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 3.6371ms | 3.3591ms | 297.6994 Ops/s | 294.1285 Ops/s | $\color{#35bf28}+1.21\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 0.7519ms | 0.4876ms | 2.0508 KOps/s | 2.0577 KOps/s | $\color{#d91a1a}-0.34\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 3.4094ms | 0.4680ms | 2.1366 KOps/s | 2.1336 KOps/s | $\color{#35bf28}+0.14\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] | 2.1557ms | 1.7314ms | 577.5572 Ops/s | 572.6197 Ops/s | $\color{#35bf28}+0.86\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] | 4.6255ms | 1.6459ms | 607.5696 Ops/s | 600.0814 Ops/s | $\color{#35bf28}+1.25\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 3.7824ms | 3.5710ms | 280.0333 Ops/s | 277.2086 Ops/s | $\color{#35bf28}+1.02\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 0.8400ms | 0.6292ms | 1.5893 KOps/s | 1.5721 KOps/s | $\color{#35bf28}+1.09\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 3.6345ms | 0.6088ms | 1.6426 KOps/s | 1.6586 KOps/s | $\color{#d91a1a}-0.96\\%$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 3.6204ms | 3.3845ms | 295.4674 Ops/s | 291.5199 Ops/s | $\color{#35bf28}+1.35\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.8390ms | 0.4930ms | 2.0283 KOps/s | 1.9996 KOps/s | $\color{#35bf28}+1.44\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 3.5110ms | 0.4759ms | 2.1014 KOps/s | 2.1301 KOps/s | $\color{#d91a1a}-1.35\\%$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 3.8034ms | 3.4164ms | 292.7069 Ops/s | 295.3296 Ops/s | $\color{#d91a1a}-0.89\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 1.0721ms | 0.4862ms | 2.0569 KOps/s | 2.0458 KOps/s | $\color{#35bf28}+0.54\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.8518ms | 0.4718ms | 2.1193 KOps/s | 2.1134 KOps/s | $\color{#35bf28}+0.28\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 3.8036ms | 3.5502ms | 281.6764 Ops/s | 280.7859 Ops/s | $\color{#35bf28}+0.32\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 0.7505ms | 0.6299ms | 1.5876 KOps/s | 1.5829 KOps/s | $\color{#35bf28}+0.30\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 3.7456ms | 0.6144ms | 1.6275 KOps/s | 1.6452 KOps/s | $\color{#d91a1a}-1.08\\%$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] | 0.1150s | 7.9697ms | 125.4757 Ops/s | 124.7191 Ops/s | $\color{#35bf28}+0.61\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] | 14.3305ms | 12.4261ms | 80.4757 Ops/s | 79.2560 Ops/s | $\color{#35bf28}+1.54\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] | 1.9796ms | 1.0747ms | 930.5033 Ops/s | 947.1344 Ops/s | $\color{#d91a1a}-1.76\\%$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] | 0.1069s | 6.0793ms | 164.4914 Ops/s | 172.0175 Ops/s | $\color{#d91a1a}-4.38\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] | 15.0027ms | 12.4494ms | 80.3253 Ops/s | 79.3396 Ops/s | $\color{#35bf28}+1.24\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] | 3.9406ms | 1.1231ms | 890.3809 Ops/s | 950.0402 Ops/s | $\textbf{\color{#d91a1a}-6.28\\%}$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] | 0.1044s | 5.8653ms | 170.4942 Ops/s | 168.0521 Ops/s | $\color{#35bf28}+1.45\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] | 15.6011ms | 12.6684ms | 78.9368 Ops/s | 78.3315 Ops/s | $\color{#35bf28}+0.77\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] | 1.9342ms | 1.2300ms | 813.0131 Ops/s | 799.8057 Ops/s | $\color{#35bf28}+1.65\\%$ |
github-actions[bot] commented 2 weeks ago

$\color{#D29922}\textsf{\Large\⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}1$. Worsened: $\large\color{#d91a1a}7$.

Expand to view detailed results | Name | Max | Mean | Ops | Ops on Repo `HEAD` | Change | | ----------------------------------------------------------------------------------------- | --------- | --------- | -------------- | ------------------ | ----------------------------------- | | test_single | 0.1232s | 0.1200s | 8.3347 Ops/s | 8.4196 Ops/s | $\color{#d91a1a}-1.01\\%$ | | test_sync | 0.1061s | 0.1036s | 9.6497 Ops/s | 9.6532 Ops/s | $\color{#d91a1a}-0.04\\%$ | | test_async | 0.1993s | 98.2931ms | 10.1737 Ops/s | 10.4088 Ops/s | $\color{#d91a1a}-2.26\\%$ | | test_single_pixels | 0.1292s | 0.1290s | 7.7523 Ops/s | 7.7646 Ops/s | $\color{#d91a1a}-0.16\\%$ | | test_sync_pixels | 84.5161ms | 81.7042ms | 12.2393 Ops/s | 12.1442 Ops/s | $\color{#35bf28}+0.78\\%$ | | test_async_pixels | 0.1533s | 67.1110ms | 14.9007 Ops/s | 14.6908 Ops/s | $\color{#35bf28}+1.43\\%$ | | test_simple | 0.8104s | 0.8098s | 1.2348 Ops/s | 1.2262 Ops/s | $\color{#35bf28}+0.71\\%$ | | test_transformed | 1.0664s | 1.0661s | 0.9380 Ops/s | 0.9298 Ops/s | $\color{#35bf28}+0.89\\%$ | | test_serial | 2.5512s | 2.4893s | 0.4017 Ops/s | 0.3974 Ops/s | $\color{#35bf28}+1.08\\%$ | | test_parallel | 2.4414s | 2.3678s | 0.4223 Ops/s | 0.4200 Ops/s | $\color{#35bf28}+0.55\\%$ | | test_step_mdp_speed[True-True-True-True-True] | 0.1193ms | 34.2868μs | 29.1658 KOps/s | 28.6779 KOps/s | $\color{#35bf28}+1.70\\%$ | | test_step_mdp_speed[True-True-True-True-False] | 0.1969ms | 20.0913μs | 49.7729 KOps/s | 49.7505 KOps/s | $\color{#35bf28}+0.04\\%$ | | test_step_mdp_speed[True-True-True-False-True] | 47.0010μs | 19.2627μs | 51.9139 KOps/s | 51.1664 KOps/s | $\color{#35bf28}+1.46\\%$ | | test_step_mdp_speed[True-True-True-False-False] | 70.2500μs | 11.3413μs | 88.1736 KOps/s | 87.3757 KOps/s | $\color{#35bf28}+0.91\\%$ | | test_step_mdp_speed[True-True-False-True-True] | 0.1607ms | 36.1703μs | 27.6470 KOps/s | 27.4530 KOps/s | $\color{#35bf28}+0.71\\%$ | | test_step_mdp_speed[True-True-False-True-False] | 44.5410μs | 21.7929μs | 45.8864 KOps/s | 44.9835 KOps/s | $\color{#35bf28}+2.01\\%$ | | test_step_mdp_speed[True-True-False-False-True] | 44.5510μs | 21.4217μs | 46.6816 KOps/s | 46.1442 KOps/s | $\color{#35bf28}+1.16\\%$ | | test_step_mdp_speed[True-True-False-False-False] | 33.2500μs | 13.2716μs | 75.3490 KOps/s | 73.8272 KOps/s | $\color{#35bf28}+2.06\\%$ | | test_step_mdp_speed[True-False-True-True-True] | 69.9310μs | 38.1815μs | 26.1907 KOps/s | 25.8993 KOps/s | $\color{#35bf28}+1.13\\%$ | | test_step_mdp_speed[True-False-True-True-False] | 0.1404ms | 23.8698μs | 41.8940 KOps/s | 41.3250 KOps/s | $\color{#35bf28}+1.38\\%$ | | test_step_mdp_speed[True-False-True-False-True] | 47.2910μs | 21.1055μs | 47.3810 KOps/s | 46.1895 KOps/s | $\color{#35bf28}+2.58\\%$ | | test_step_mdp_speed[True-False-True-False-False] | 33.0300μs | 13.1821μs | 75.8606 KOps/s | 73.8621 KOps/s | $\color{#35bf28}+2.71\\%$ | | test_step_mdp_speed[True-False-False-True-True] | 65.2310μs | 39.7690μs | 25.1452 KOps/s | 25.0230 KOps/s | $\color{#35bf28}+0.49\\%$ | | test_step_mdp_speed[True-False-False-True-False] | 49.4500μs | 25.4994μs | 39.2167 KOps/s | 38.7133 KOps/s | $\color{#35bf28}+1.30\\%$ | | test_step_mdp_speed[True-False-False-False-True] | 45.5410μs | 23.1078μs | 43.2754 KOps/s | 42.7476 KOps/s | $\color{#35bf28}+1.23\\%$ | | test_step_mdp_speed[True-False-False-False-False] | 0.1454ms | 14.9467μs | 66.9045 KOps/s | 65.4756 KOps/s | $\color{#35bf28}+2.18\\%$ | | test_step_mdp_speed[False-True-True-True-True] | 63.7200μs | 37.9562μs | 26.3462 KOps/s | 26.0818 KOps/s | $\color{#35bf28}+1.01\\%$ | | test_step_mdp_speed[False-True-True-True-False] | 45.7610μs | 23.6832μs | 42.2241 KOps/s | 41.4602 KOps/s | $\color{#35bf28}+1.84\\%$ | | test_step_mdp_speed[False-True-True-False-True] | 44.0800μs | 25.5386μs | 39.1564 KOps/s | 38.5318 KOps/s | $\color{#35bf28}+1.62\\%$ | | test_step_mdp_speed[False-True-True-False-False] | 40.0710μs | 14.9864μs | 66.7270 KOps/s | 64.3609 KOps/s | $\color{#35bf28}+3.68\\%$ | | test_step_mdp_speed[False-True-False-True-True] | 75.0910μs | 39.2495μs | 25.4780 KOps/s | 24.9286 KOps/s | $\color{#35bf28}+2.20\\%$ | | test_step_mdp_speed[False-True-False-True-False] | 41.5710μs | 25.6008μs | 39.0612 KOps/s | 38.5915 KOps/s | $\color{#35bf28}+1.22\\%$ | | test_step_mdp_speed[False-True-False-False-True] | 0.2086ms | 27.2054μs | 36.7574 KOps/s | 35.9408 KOps/s | $\color{#35bf28}+2.27\\%$ | | test_step_mdp_speed[False-True-False-False-False] | 38.4600μs | 16.8436μs | 59.3696 KOps/s | 57.9632 KOps/s | $\color{#35bf28}+2.43\\%$ | | test_step_mdp_speed[False-False-True-True-True] | 68.9810μs | 41.6805μs | 23.9920 KOps/s | 23.7883 KOps/s | $\color{#35bf28}+0.86\\%$ | | test_step_mdp_speed[False-False-True-True-False] | 48.0510μs | 27.8988μs | 35.8438 KOps/s | 35.7070 KOps/s | $\color{#35bf28}+0.38\\%$ | | test_step_mdp_speed[False-False-True-False-True] | 54.6310μs | 27.2896μs | 36.6440 KOps/s | 36.3947 KOps/s | $\color{#35bf28}+0.69\\%$ | | test_step_mdp_speed[False-False-True-False-False] | 38.9910μs | 16.8906μs | 59.2046 KOps/s | 58.3899 KOps/s | $\color{#35bf28}+1.40\\%$ | | test_step_mdp_speed[False-False-False-True-True] | 64.1400μs | 43.4519μs | 23.0140 KOps/s | 22.9028 KOps/s | $\color{#35bf28}+0.49\\%$ | | test_step_mdp_speed[False-False-False-True-False] | 55.6200μs | 29.4249μs | 33.9848 KOps/s | 33.7990 KOps/s | $\color{#35bf28}+0.55\\%$ | | test_step_mdp_speed[False-False-False-False-True] | 51.5500μs | 28.4812μs | 35.1108 KOps/s | 34.8472 KOps/s | $\color{#35bf28}+0.76\\%$ | | test_step_mdp_speed[False-False-False-False-False] | 91.1120μs | 18.5227μs | 53.9877 KOps/s | 53.1589 KOps/s | $\color{#35bf28}+1.56\\%$ | | test_values[generalized_advantage_estimate-True-True] | 26.8819ms | 25.2369ms | 39.6245 Ops/s | 40.4081 Ops/s | $\color{#d91a1a}-1.94\\%$ | | test_values[vec_generalized_advantage_estimate-True-True] | 95.8692ms | 2.8166ms | 355.0327 Ops/s | 363.5935 Ops/s | $\color{#d91a1a}-2.35\\%$ | | test_values[td0_return_estimate-False-False] | 89.5310μs | 65.6460μs | 15.2332 KOps/s | 14.8522 KOps/s | $\color{#35bf28}+2.57\\%$ | | test_values[td1_return_estimate-False-False] | 60.0118ms | 59.4123ms | 16.8315 Ops/s | 18.1729 Ops/s | $\textbf{\color{#d91a1a}-7.38\\%}$ | | test_values[vec_td1_return_estimate-False-False] | 1.4829ms | 1.0999ms | 909.2100 Ops/s | 917.9444 Ops/s | $\color{#d91a1a}-0.95\\%$ | | test_values[td_lambda_return_estimate-True-False] | 95.4496ms | 94.6205ms | 10.5685 Ops/s | 11.5088 Ops/s | $\textbf{\color{#d91a1a}-8.17\\%}$ | | test_values[vec_td_lambda_return_estimate-True-False] | 1.4788ms | 1.0895ms | 917.8754 Ops/s | 920.6039 Ops/s | $\color{#d91a1a}-0.30\\%$ | | test_gae_speed[generalized_advantage_estimate-False-1-512] | 26.8246ms | 26.3212ms | 37.9921 Ops/s | 40.3338 Ops/s | $\textbf{\color{#d91a1a}-5.81\\%}$ | | test_gae_speed[vec_generalized_advantage_estimate-True-1-512] | 0.9554ms | 0.7252ms | 1.3789 KOps/s | 1.3816 KOps/s | $\color{#d91a1a}-0.19\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-False-1-512] | 0.8274ms | 0.6707ms | 1.4910 KOps/s | 1.4907 KOps/s | $\color{#35bf28}+0.02\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-True-32-512] | 1.6176ms | 1.4771ms | 677.0029 Ops/s | 679.4629 Ops/s | $\color{#d91a1a}-0.36\\%$ | | test_gae_speed[vec_generalized_advantage_estimate-False-32-512] | 0.8416ms | 0.6861ms | 1.4575 KOps/s | 1.4553 KOps/s | $\color{#35bf28}+0.15\\%$ | | test_dqn_speed | 80.5804ms | 1.6176ms | 618.1996 Ops/s | 662.2149 Ops/s | $\textbf{\color{#d91a1a}-6.65\\%}$ | | test_ddpg_speed | 3.2667ms | 3.0304ms | 329.9841 Ops/s | 329.1763 Ops/s | $\color{#35bf28}+0.25\\%$ | | test_sac_speed | 9.2420ms | 8.5431ms | 117.0531 Ops/s | 115.2498 Ops/s | $\color{#35bf28}+1.56\\%$ | | test_redq_speed | 11.8120ms | 10.8139ms | 92.4735 Ops/s | 91.7499 Ops/s | $\color{#35bf28}+0.79\\%$ | | test_redq_deprec_speed | 0.1085s | 12.7741ms | 78.2836 Ops/s | 84.2524 Ops/s | $\textbf{\color{#d91a1a}-7.08\\%}$ | | test_td3_speed | 8.6055ms | 8.5137ms | 117.4576 Ops/s | 114.3968 Ops/s | $\color{#35bf28}+2.68\\%$ | | test_cql_speed | 26.9418ms | 26.3344ms | 37.9731 Ops/s | 37.7495 Ops/s | $\color{#35bf28}+0.59\\%$ | | test_a2c_speed | 6.0746ms | 5.8249ms | 171.6773 Ops/s | 173.4191 Ops/s | $\color{#d91a1a}-1.00\\%$ | | test_ppo_speed | 6.8971ms | 6.1405ms | 162.8526 Ops/s | 163.9291 Ops/s | $\color{#d91a1a}-0.66\\%$ | | test_reinforce_speed | 4.9748ms | 4.7670ms | 209.7736 Ops/s | 209.5239 Ops/s | $\color{#35bf28}+0.12\\%$ | | test_iql_speed | 20.6124ms | 19.9671ms | 50.0823 Ops/s | 50.0427 Ops/s | $\color{#35bf28}+0.08\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 4.7636ms | 4.6183ms | 216.5320 Ops/s | 215.6513 Ops/s | $\color{#35bf28}+0.41\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.7696ms | 0.5949ms | 1.6808 KOps/s | 1.6623 KOps/s | $\color{#35bf28}+1.12\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 4.4924ms | 0.5748ms | 1.7398 KOps/s | 1.7364 KOps/s | $\color{#35bf28}+0.20\\%$ | | test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 4.8464ms | 4.6025ms | 217.2729 Ops/s | 217.6254 Ops/s | $\color{#d91a1a}-0.16\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 0.7713ms | 0.5909ms | 1.6923 KOps/s | 1.6779 KOps/s | $\color{#35bf28}+0.86\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.8235ms | 0.5673ms | 1.7627 KOps/s | 1.7422 KOps/s | $\color{#35bf28}+1.18\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] | 2.3371ms | 2.1247ms | 470.6452 Ops/s | 459.2899 Ops/s | $\color{#35bf28}+2.47\\%$ | | test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] | 2.2297ms | 2.0116ms | 497.1202 Ops/s | 486.0605 Ops/s | $\color{#35bf28}+2.28\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 4.9422ms | 4.7383ms | 211.0452 Ops/s | 210.5840 Ops/s | $\color{#35bf28}+0.22\\%$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 0.1304s | 0.8851ms | 1.1298 KOps/s | 1.3224 KOps/s | $\textbf{\color{#d91a1a}-14.56\\%}$ | | test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 0.8699ms | 0.7210ms | 1.3870 KOps/s | 1.3462 KOps/s | $\color{#35bf28}+3.03\\%$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 6.4556ms | 4.7647ms | 209.8747 Ops/s | 216.7063 Ops/s | $\color{#d91a1a}-3.15\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.8421ms | 0.5959ms | 1.6782 KOps/s | 1.6683 KOps/s | $\color{#35bf28}+0.60\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 4.7049ms | 0.5779ms | 1.7303 KOps/s | 1.7282 KOps/s | $\color{#35bf28}+0.12\\%$ | | test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 4.8723ms | 4.6025ms | 217.2751 Ops/s | 218.4996 Ops/s | $\color{#d91a1a}-0.56\\%$ | | test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 0.1265s | 0.7769ms | 1.2872 KOps/s | 1.6786 KOps/s | $\textbf{\color{#d91a1a}-23.31\\%}$ | | test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.7289ms | 0.5664ms | 1.7654 KOps/s | 1.7458 KOps/s | $\color{#35bf28}+1.12\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 4.9381ms | 4.7599ms | 210.0899 Ops/s | 208.9765 Ops/s | $\color{#35bf28}+0.53\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 0.9146ms | 0.7436ms | 1.3448 KOps/s | 1.3265 KOps/s | $\color{#35bf28}+1.38\\%$ | | test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 4.9564ms | 0.7336ms | 1.3632 KOps/s | 1.3668 KOps/s | $\color{#d91a1a}-0.27\\%$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] | 0.1297s | 7.5110ms | 133.1384 Ops/s | 132.1442 Ops/s | $\color{#35bf28}+0.75\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] | 18.3278ms | 15.7261ms | 63.5884 Ops/s | 62.8461 Ops/s | $\color{#35bf28}+1.18\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] | 2.5858ms | 1.3454ms | 743.2634 Ops/s | 760.0069 Ops/s | $\color{#d91a1a}-2.20\\%$ | | test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] | 0.1288s | 9.9584ms | 100.4182 Ops/s | 100.3640 Ops/s | $\color{#35bf28}+0.05\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] | 18.6051ms | 15.7119ms | 63.6461 Ops/s | 62.8111 Ops/s | $\color{#35bf28}+1.33\\%$ | | test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] | 2.5834ms | 1.3368ms | 748.0423 Ops/s | 752.7290 Ops/s | $\color{#d91a1a}-0.62\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] | 0.1270s | 7.6309ms | 131.0461 Ops/s | 131.3218 Ops/s | $\color{#d91a1a}-0.21\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] | 18.7081ms | 15.8562ms | 63.0668 Ops/s | 62.2987 Ops/s | $\color{#35bf28}+1.23\\%$ | | test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] | 2.7689ms | 1.5116ms | 661.5633 Ops/s | 615.5215 Ops/s | $\textbf{\color{#35bf28}+7.48\\%}$ |