search

pytorch / rl

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
https://pytorch.org/rl
MIT License
2.19k stars 289 forks source link

[Feature] MCTSForest #2307

Open vmoens opened 1 month ago

vmoens commented 1 month ago

Stack from ghstack (oldest at bottom):

pytorch-bot[bot] commented 1 month ago

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2307

Note: Links to docs will display an error until the docs builds have been completed.

:x: 18 New Failures, 1 Cancelled Job, 8 Unrelated Failures

As of commit a382e65178725ba769fef6a537c3aee625c19919 with merge base 35a1c5b5782dd918b7f857c44eb6c019a9ec8c41 (image):

NEW FAILURES - The following jobs have failed:

* [Continuous Benchmark (PR) / CPU Pytest benchmark](https://hud.pytorch.org/pr/pytorch/rl/2307#28324243321) ([gh](https://github.com/pytorch/rl/actions/runs/10239077923/job/28324243321)) `Process completed with exit code 1.` * [Continuous Benchmark (PR) / GPU Pytest benchmark](https://hud.pytorch.org/pr/pytorch/rl/2307#28324243922) ([gh](https://github.com/pytorch/rl/actions/runs/10239077923/job/28324243922)) `Process completed with exit code 4.` * [Examples Tests on Linux / tests (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2307#28324245359) ([gh](https://github.com/pytorch/rl/actions/runs/10239077949/job/28324245359)) `RuntimeError: Command docker exec -t 14193ca041f62cd1b92069cf8c53b26d2bf6e6edb5393e2f12ba190beab108e9 /exec failed with exit code 1` * [Habitat Tests on Linux / tests (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2307#28324245487) ([gh](https://github.com/pytorch/rl/actions/runs/10239077944/job/28324245487)) `RuntimeError: Command docker exec -t d25ea0f12e7fbc51c12d008dfa66006863b7622d43330f0038be31eed20e4781 /exec failed with exit code 1` * [Libs Tests on Linux / unittests-gym (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2307#28324252383) ([gh](https://github.com/pytorch/rl/actions/runs/10239077946/job/28324252383)) `RuntimeError: Command docker exec -t 96a413c9d8ec2b67b320071680f98929c186712bddc841e41bae7b2224e33894 /exec failed with exit code 1` * [Libs Tests on Linux / unittests-sklearn (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2307#28324252557) ([gh](https://github.com/pytorch/rl/actions/runs/10239077946/job/28324252557)) `RuntimeError: Command docker exec -t 89778aa1b265b8283163308beabe1197e34367340724882a00db328bc82db23d /exec failed with exit code 1` * [Lint / python-source-and-configs / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2307#28324245258) ([gh](https://github.com/pytorch/rl/actions/runs/10239077959/job/28324245258)) `RuntimeError: Command docker exec -t 8f6073422509c18ce450d888aee5c5574c8e110601ac15e9117d76626bbd5a12 /exec failed with exit code 1` * [RLHF Tests on Linux / unittests (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2307#28324245318) ([gh](https://github.com/pytorch/rl/actions/runs/10239077958/job/28324245318)) `RuntimeError: Command docker exec -t 792a7c8d4072a2237f01531c96e24937cfcd12388e7f43165db7caaefc1937f8 /exec failed with exit code 1` * [Unit-tests on Linux / tests-cpu (3.10) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2307#28324245568) ([gh](https://github.com/pytorch/rl/actions/runs/10239077956/job/28324245568)) `RuntimeError: Command docker exec -t 61cc000740f2ea5aa87abb247bad005e5414bf6a285ef4d035776ee6f63eba45 /exec failed with exit code 1` * [Unit-tests on Linux / tests-cpu (3.11) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2307#28324246309) ([gh](https://github.com/pytorch/rl/actions/runs/10239077956/job/28324246309)) `RuntimeError: Command docker exec -t 592824bcdc2302e4a2d51e9cefd15ee1e92e4c2b1ba26a9cd8fbef32d7a31529 /exec failed with exit code 1` * [Unit-tests on Linux / tests-cpu (3.12) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2307#28324246822) ([gh](https://github.com/pytorch/rl/actions/runs/10239077956/job/28324246822)) `RuntimeError: Command docker exec -t 13069841496a05bf81d76d52d7e94eb2a7d4d33600da3ad13c072c81a86e042d /exec failed with exit code 1` * [Unit-tests on Linux / tests-cpu (3.8) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2307#28324247947) ([gh](https://github.com/pytorch/rl/actions/runs/10239077956/job/28324247947)) `RuntimeError: Command docker exec -t 19cb8d9f0d93bd9f26c0a11f7a5e050917659bacb03db22bc4ffe8a3700f4568 /exec failed with exit code 1` * [Unit-tests on Linux / tests-cpu (3.9) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2307#28324248896) ([gh](https://github.com/pytorch/rl/actions/runs/10239077956/job/28324248896)) `RuntimeError: Command docker exec -t 24ba3c6590f276bde923a866e56ccf1cf0e2ab51dcd7e9cf512a43df6a995052 /exec failed with exit code 1` * [Unit-tests on Linux / tests-gpu (3.11, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2307#28324250832) ([gh](https://github.com/pytorch/rl/actions/runs/10239077956/job/28324250832)) `RuntimeError: Command docker exec -t 196248be2f11602d58301c23bd32fcf512a9b52c854c7b2b84d59d0089d9284b /exec failed with exit code 1` * [Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2307#28324251377) ([gh](https://github.com/pytorch/rl/actions/runs/10239077956/job/28324251377)) `RuntimeError: Command docker exec -t 5dc1890ab575f89cf326656ee8d40bcffef38224b170b6a1e0dc62585e342763 /exec failed with exit code 1` * [Unit-tests on Linux / tests-optdeps (3.10, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2307#28324251670) ([gh](https://github.com/pytorch/rl/actions/runs/10239077956/job/28324251670)) `RuntimeError: Command docker exec -t 78001c21d822c73bc1231d90d1e85e41d8fa745593b891622d3bb3514dcf7674 /exec failed with exit code 1` * [Unit-tests on Linux / tests-stable-gpu (3.10, 11.8) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2307#28324251524) ([gh](https://github.com/pytorch/rl/actions/runs/10239077956/job/28324251524)) `RuntimeError: Command docker exec -t 650c9922e61158d51f903ce486bb4a8dac703b1dd4607b67b868984cf53b4ef7 /exec failed with exit code 1` * [Wheels / build-wheel-windows (3.12, 3.12)](https://hud.pytorch.org/pr/pytorch/rl/2307#28324271526) ([gh](https://github.com/pytorch/rl/actions/runs/10239077918/job/28324271526)) `Process completed with exit code 1.`

CANCELLED JOB - The following job was cancelled. Please retry:

* [Wheels / build-wheel-windows (3.9, 3.9)](https://hud.pytorch.org/pr/pytorch/rl/2307#28324271333) ([gh](https://github.com/pytorch/rl/actions/runs/10239077918/job/28324271333))

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

* [Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cpu](https://hud.pytorch.org/pr/pytorch/rl/2307#28345891773) ([gh](https://github.com/pytorch/rl/actions/runs/10239077961/job/28345891773)) ([similar failure](https://hud.pytorch.org/pytorch/rl/commit/a382e65178725ba769fef6a537c3aee625c19919#28345892338)) `Unable to find any artifacts for the associated workflow` * [Wheels / build-wheel-windows (3.10, 3.10.3)](https://hud.pytorch.org/pr/pytorch/rl/2307#28324271425) ([gh](https://github.com/pytorch/rl/actions/runs/10239077918/job/28324271425)) (matched **win** rule in [flaky-rules.json](https://github.com/pytorch/test-infra/blob/generated-stats/stats/flaky-rules.json)) `##[error]The operation was canceled.` * [Wheels / build-wheel-windows (3.11, 3.11)](https://hud.pytorch.org/pr/pytorch/rl/2307#28324271471) ([gh](https://github.com/pytorch/rl/actions/runs/10239077918/job/28324271471)) (matched **win** rule in [flaky-rules.json](https://github.com/pytorch/test-infra/blob/generated-stats/stats/flaky-rules.json)) `##[error]The operation was canceled.` * [Wheels / build-wheel-windows (3.8, 3.8)](https://hud.pytorch.org/pr/pytorch/rl/2307#28324271234) ([gh](https://github.com/pytorch/rl/actions/runs/10239077918/job/28324271234)) (matched **win** rule in [flaky-rules.json](https://github.com/pytorch/test-infra/blob/generated-stats/stats/flaky-rules.json)) `##[error]The operation was canceled.`

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

* [Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cuda11_8](https://hud.pytorch.org/pr/pytorch/rl/2307#28345892081) ([gh](https://github.com/pytorch/rl/actions/runs/10239077961/job/28345892081)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/35a1c5b5782dd918b7f857c44eb6c019a9ec8c41#28331315809)) * [Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cuda12_1](https://hud.pytorch.org/pr/pytorch/rl/2307#28345892338) ([gh](https://github.com/pytorch/rl/actions/runs/10239077961/job/28345892338)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/35a1c5b5782dd918b7f857c44eb6c019a9ec8c41#28331315968)) `Unable to find any artifacts for the associated workflow` * [Build Windows Wheels / pytorch/rl (pytorch/rl, python packaging/wheel/relocate.py, test/smoke_test.py, torchrl) / upload / wheel-py3_9-cuda12_4](https://hud.pytorch.org/pr/pytorch/rl/2307#28345892643) ([gh](https://github.com/pytorch/rl/actions/runs/10239077961/job/28345892643)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/35a1c5b5782dd918b7f857c44eb6c019a9ec8c41#28331316129)) `Unable to find any artifacts for the associated workflow` * [Unit-tests on Windows / unittests-cpu / windows-job](https://hud.pytorch.org/pr/pytorch/rl/2307#28324244603) ([gh](https://github.com/pytorch/rl/actions/runs/10239077943/job/28324244603)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/35a1c5b5782dd918b7f857c44eb6c019a9ec8c41#28319604046)) `Process completed with exit code 1.`

This comment was automatically generated by Dr. CI and updates every 15 minutes.