Convert `TensorDictModuleWrapper`s to `TensorDictModule`s - Githubissues

pytorch / rl

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.

https://pytorch.org/rl

MIT License

2.19k stars 289 forks source link

Convert `TensorDictModuleWrapper`s to `TensorDictModule`s #2295

Closed kurtamohler closed 1 month ago

kurtamohler commented 1 month ago

Motivation

EGreedyWrapper was converted to EGreedyModule a while ago because TensorDictModules are more user-friendly than TensorDictModuleWrappers.

There are still some TensorDictModuleWrappers that have not been converted to a TensorDictModule:

Solution

We should convert these remaining TensorDictModuleWrappers to TensorDictModules.

Alternatives

Additional context

Checklist

[x] I have checked that there is no similar issue in the repo (required)