pytorch / rl

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
https://pytorch.org/rl
MIT License
2.19k stars 289 forks source link

[Refactor] Update all instances of exploration `*Wrapper` to `*Module` #2298

Closed kurtamohler closed 1 month ago

kurtamohler commented 1 month ago

Description

Update instances of

everywhere in the code base, except in test/test_exploration.py, which should still test both the wrappers and modules until we finally remove the wrappers in the future.

Motivation and Context

close #2295

Types of changes

What types of changes does your code introduce? Remove all that do not apply:

Checklist

Go over all the following points, and put an x in all the boxes that apply. If you are unsure about any of these, don't hesitate to ask. We are here to help!

pytorch-bot[bot] commented 1 month ago

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2298

Note: Links to docs will display an error until the docs builds have been completed.

:x: 3 New Failures, 1 Pending, 3 Unrelated Failures

As of commit 085bef26bbae6455947ab75572185d45c50bdcb8 with merge base bdc97846dbcaffbd62da8f24aecce437fde9f60b (image):

NEW FAILURES - The following jobs have failed:

* [Continuous Benchmark (PR) / CPU Pytest benchmark](https://hud.pytorch.org/pr/pytorch/rl/2298#27735460591) ([gh](https://github.com/pytorch/rl/actions/runs/10036865150/job/27735460591)) `Workflow failed! Resource not accessible by integration` * [Continuous Benchmark (PR) / GPU Pytest benchmark](https://hud.pytorch.org/pr/pytorch/rl/2298#27735459973) ([gh](https://github.com/pytorch/rl/actions/runs/10036865150/job/27735459973)) `Workflow failed! Resource not accessible by integration` * [Habitat Tests on Linux / tests (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2298#27735461584) ([gh](https://github.com/pytorch/rl/actions/runs/10036865167/job/27735461584)) `RuntimeError: Command docker exec -t ba7908e7c0e8344ef0340e0037bf3eac7930d57ae660aeae20bf2a7649045a38 /exec failed with exit code 139`

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

* [Libs Tests on Linux / unittests-gym (3.9, 12.1) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2298#27735466988) ([gh](https://github.com/pytorch/rl/actions/runs/10036865174/job/27735466988)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/bdc97846dbcaffbd62da8f24aecce437fde9f60b#27674786692)) `AttributeError: module 'torch' has no attribute 'compiler'` * [Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job](https://hud.pytorch.org/pr/pytorch/rl/2298#27735464766) ([gh](https://github.com/pytorch/rl/actions/runs/10036865177/job/27735464766)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/bdc97846dbcaffbd62da8f24aecce437fde9f60b#27674785660)) `AttributeError: module 'torch' has no attribute 'compiler'` * [Unit-tests on Windows / unittests-cpu / windows-job](https://hud.pytorch.org/pr/pytorch/rl/2298#27735460578) ([gh](https://github.com/pytorch/rl/actions/runs/10036865185/job/27735460578)) ([trunk failure](https://hud.pytorch.org/pytorch/rl/commit/bdc97846dbcaffbd62da8f24aecce437fde9f60b#27674782343)) `test/test_transforms.py::TestActionDiscretizer::test_trans_parallel_env_check[False]`

This comment was automatically generated by Dr. CI and updates every 15 minutes.