[BUG] Tutorial #4, gym compat - Githubissues

pytorch / rl

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.

https://pytorch.org/rl

MIT License

2.38k stars 315 forks source link

[BUG] Tutorial #4, gym compat #2495

Open MaximilienLC opened 1 month ago

MaximilienLC commented 1 month ago

Describe the bug

The cell

from torchrl.envs import [GymEnv](https://pytorch.org/docs/stable/generated/torch.nn.Module.html#torch.nn.Module)

env = [GymEnv](https://pytorch.org/docs/stable/generated/torch.nn.Module.html#torch.nn.Module)("CartPole-v1", from_pixels=True, pixels_only=False)

print(env.rollout(max_steps=3))

from torchrl.envs import [TransformedEnv]

from tutorial # 4 (https://pytorch.org/rl/stable/tutorials/getting-started-4.html)

returns ModuleNotFoundError: No module named 'gymnasium.wrappers.compatibility' with gymnasium==1.0.0 & torchrl==0.5.0.

Reason and Possible fixes

If you know or suspect the reason for this bug, paste the code lines and suggest modifications.

Checklist

[x ] I have checked that there is no similar issue in the repo (required)
[x ] I have read the documentation (required)
[ x] I have provided a minimal working example to reproduce the bug (required)

vmoens commented 1 month ago

Hey! This seems to be due to gymnasium 1.0 which has many bc breaking changes. Unfortunately we do f intend on supporting that version and any further release of gymnasium until some concerns are addressed (see https://github.com/pytorch/rl/discussions/2483 and https://github.com/pytorch/rl/pull/2473 for context). Sorry about that