pytorch / rl

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
https://pytorch.org/rl
MIT License
2.19k stars 289 forks source link

[Feature] TensorDictMap #2306

Open vmoens opened 1 month ago

vmoens commented 1 month ago

Stack from ghstack (oldest at bottom):

pytorch-bot[bot] commented 1 month ago

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2306

Note: Links to docs will display an error until the docs builds have been completed.

:x: 6 New Failures, 2 Cancelled Jobs, 14 Unrelated Failures

As of commit b2aa45366ee349cb6125fbdefa8c73e81dce1468 with merge base 35a1c5b5782dd918b7f857c44eb6c019a9ec8c41 (image):

NEW FAILURES - The following jobs have failed:

* [Continuous Benchmark (PR) / CPU Pytest benchmark](https://hud.pytorch.org/pr/pytorch/rl/2306#28324243425) ([gh](https://github.com/pytorch/rl/actions/runs/10239077909/job/28324243425)) `Process completed with exit code 1.` * [Continuous Benchmark (PR) / GPU Pytest benchmark](https://hud.pytorch.org/pr/pytorch/rl/2306#28324243980) ([gh](https://github.com/pytorch/rl/actions/runs/10239077909/job/28324243980)) `Process completed with exit code 1.` * [Habitat Tests on Linux / tests (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2306#28324245069) ([gh](https://github.com/pytorch/rl/actions/runs/10239077928/job/28324245069)) `RuntimeError: Command docker exec -t 9554591e706d1d6475033cd797c4ffee332c44cb3026b7e66d67e982d7826c51 /exec failed with exit code 139` * [Wheels / build-wheel-windows (3.11, 3.11)](https://hud.pytorch.org/pr/pytorch/rl/2306#28324271489) ([gh](https://github.com/pytorch/rl/actions/runs/10239077904/job/28324271489)) `Process completed with exit code 1.` * [Wheels / build-wheel-windows (3.12, 3.12)](https://hud.pytorch.org/pr/pytorch/rl/2306#28324271542) ([gh](https://github.com/pytorch/rl/actions/runs/10239077904/job/28324271542)) `Process completed with exit code 1.` * [Wheels / build-wheel-windows (3.9, 3.9)](https://hud.pytorch.org/pr/pytorch/rl/2306#28324271384) ([gh](https://github.com/pytorch/rl/actions/runs/10239077904/job/28324271384)) `Process completed with exit code 1.`

CANCELLED JOBS - The following jobs were cancelled. Please retry:

* [Wheels / build-wheel-windows (3.10, 3.10.3)](https://hud.pytorch.org/pr/pytorch/rl/2306#28324271441) ([gh](https://github.com/pytorch/rl/actions/runs/10239077904/job/28324271441)) * [Wheels / build-wheel-windows (3.8, 3.8)](https://hud.pytorch.org/pr/pytorch/rl/2306#28324271323) ([gh](https://github.com/pytorch/rl/actions/runs/10239077904/job/28324271323))

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

* [Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cpu](https://hud.pytorch.org/pr/pytorch/rl/2306#28345952899) ([gh](https://github.com/pytorch/rl/actions/runs/10239077945/job/28345952899)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/35a1c5b5782dd918b7f857c44eb6c019a9ec8c41#28331315378)) * [Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cuda11_8](https://hud.pytorch.org/pr/pytorch/rl/2306#28345953216) ([gh](https://github.com/pytorch/rl/actions/runs/10239077945/job/28345953216)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/35a1c5b5782dd918b7f857c44eb6c019a9ec8c41#28331315809)) * [Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cuda12_1](https://hud.pytorch.org/pr/pytorch/rl/2306#28345953524) ([gh](https://github.com/pytorch/rl/actions/runs/10239077945/job/28345953524)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/35a1c5b5782dd918b7f857c44eb6c019a9ec8c41#28331315968)) `Unable to find any artifacts for the associated workflow` * [Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cuda12_4](https://hud.pytorch.org/pr/pytorch/rl/2306#28345953813) ([gh](https://github.com/pytorch/rl/actions/runs/10239077945/job/28345953813)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/35a1c5b5782dd918b7f857c44eb6c019a9ec8c41#28331316129)) `Unable to find any artifacts for the associated workflow` * [Unit-tests on Linux / tests-cpu (3.10) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2306#28324245394) ([gh](https://github.com/pytorch/rl/actions/runs/10239077934/job/28324245394)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/35a1c5b5782dd918b7f857c44eb6c019a9ec8c41#28319604462)) `test/test_transforms.py::TestRenameTransform::test_rename_done_reward[False]` * [Unit-tests on Linux / tests-cpu (3.11) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2306#28324246116) ([gh](https://github.com/pytorch/rl/actions/runs/10239077934/job/28324246116)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/35a1c5b5782dd918b7f857c44eb6c019a9ec8c41#28319604596)) `test/test_transforms.py::TestRenameTransform::test_rename_done_reward[False]` * [Unit-tests on Linux / tests-cpu (3.12) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2306#28324246593) ([gh](https://github.com/pytorch/rl/actions/runs/10239077934/job/28324246593)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/35a1c5b5782dd918b7f857c44eb6c019a9ec8c41#28319604890)) `test/test_transforms.py::TestRenameTransform::test_rename_done_reward[False]` * [Unit-tests on Linux / tests-cpu (3.8) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2306#28324247000) ([gh](https://github.com/pytorch/rl/actions/runs/10239077934/job/28324247000)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/35a1c5b5782dd918b7f857c44eb6c019a9ec8c41#28319605111)) `test/test_transforms.py::TestRenameTransform::test_rename_done_reward[False]` * [Unit-tests on Linux / tests-cpu (3.9) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2306#28324248201) ([gh](https://github.com/pytorch/rl/actions/runs/10239077934/job/28324248201)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/35a1c5b5782dd918b7f857c44eb6c019a9ec8c41#28319605181)) `test/test_transforms.py::TestRenameTransform::test_rename_done_reward[False]` * [Unit-tests on Linux / tests-gpu (3.11, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2306#28324250267) ([gh](https://github.com/pytorch/rl/actions/runs/10239077934/job/28324250267)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/35a1c5b5782dd918b7f857c44eb6c019a9ec8c41#28319605250)) `test/test_transforms.py::TestRenameTransform::test_rename_done_reward[False]` * [Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2306#28324251215) ([gh](https://github.com/pytorch/rl/actions/runs/10239077934/job/28324251215)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/35a1c5b5782dd918b7f857c44eb6c019a9ec8c41#28319605312)) `test/test_transforms.py::TestRenameTransform::test_rename_done_reward[False]` * [Unit-tests on Linux / tests-optdeps (3.10, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2306#28324251426) ([gh](https://github.com/pytorch/rl/actions/runs/10239077934/job/28324251426)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/35a1c5b5782dd918b7f857c44eb6c019a9ec8c41#28319605395)) `test/test_transforms.py::TestRenameTransform::test_rename_done_reward[False]` * [Unit-tests on Linux / tests-stable-gpu (3.10, 11.8) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2306#28324251567) ([gh](https://github.com/pytorch/rl/actions/runs/10239077934/job/28324251567)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/35a1c5b5782dd918b7f857c44eb6c019a9ec8c41#28319605482)) `test/test_transforms.py::TestRenameTransform::test_rename_done_reward[False]` * [Unit-tests on Windows / unittests-cpu / windows-job](https://hud.pytorch.org/pr/pytorch/rl/2306#28324244555) ([gh](https://github.com/pytorch/rl/actions/runs/10239077927/job/28324244555)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/35a1c5b5782dd918b7f857c44eb6c019a9ec8c41#28319604046)) `Process completed with exit code 1.`

This comment was automatically generated by Dr. CI and updates every 15 minutes.